-- Logs begin at Thu 2022-05-12 06:26:13 UTC, end at Thu 2022-05-12 07:29:06 UTC. -- May 12 07:01:34.259827 dv-osbrick-830800-12-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 12 07:01:34.270087 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 07:01:34 2022] *** May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: nodename: dv-osbrick-830800-12-ceph May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: machine: x86_64 May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: clock source: unix May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: pcre jit disabled May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: detected number of CPU cores: 4 May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: current working directory: / May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: detected binary path: /usr/bin/uwsgi-core May 12 07:01:34.272107 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: your processes number limit is 47680 May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: your memory page size is 4096 bytes May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: detected max file descriptor number: 2048 May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: lock engine: pthread robust mutexes May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: thunder lock: enabled May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 07:01:34.272774 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 07:01:34.322558 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: Python main interpreter initialized at 0x5643ffe809c0 May 12 07:01:34.322558 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: python threads support enabled May 12 07:01:34.322558 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: your server socket listen backlog is limited to 100 connections May 12 07:01:34.322558 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: your mercy for graceful operations on workers is 90 seconds May 12 07:01:34.322951 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: mapped 403077 bytes (393 KB) for 2 cores May 12 07:01:34.323028 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: *** Operational MODE: preforking *** May 12 07:01:34.323248 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: *** uWSGI is running in multiple interpreter mode *** May 12 07:01:34.323248 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: spawned uWSGI master process (pid: 86893) May 12 07:01:34.323461 dv-osbrick-830800-12-ceph systemd[1]: Started Devstack devstack@keystone.service. May 12 07:01:34.325150 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: spawned uWSGI worker 1 (pid: 86909, cores: 1) May 12 07:01:34.325150 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: spawned uWSGI worker 2 (pid: 86910, cores: 1) May 12 07:01:34.325150 dv-osbrick-830800-12-ceph devstack@keystone.service[86893]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 07:01:40.165526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 07:01:40.165526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: from cryptography.utils import int_from_bytes May 12 07:01:40.166305 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 07:01:40.166305 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: from cryptography.utils import int_from_bytes May 12 07:01:40.202791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 07:01:40.202791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: from cryptography.utils import int_from_bytes May 12 07:01:40.203723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 07:01:40.203723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: from cryptography.utils import int_from_bytes May 12 07:01:40.216901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 07:01:40.217108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 07:01:40.217287 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] command line args: [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 07:01:40.217558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 07:01:40.217736 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ================================================================================ {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 07:01:40.217990 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] admin_token = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.218238 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] config_dir = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.218427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.218608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] config_source = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.218787 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] debug = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.218985 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.220725 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.220956 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.221177 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.221439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.221679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.221860 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_config_append = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.222065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.222244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_dir = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.222413 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_file = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.222630 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.222880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.223130 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.223379 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.223553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.223763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.223976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.224517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.224743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.224931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.225433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.225667 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.225916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.226164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.226443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.226932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.227114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] publish_errors = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.227347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.227579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.227757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.228028 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.228264 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.228507 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] standard_threads = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.228743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.228989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.229168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.229348 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] use_journal = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.229525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] use_json = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.229702 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] use_stderr = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.229879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] use_syslog = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.230111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.230368 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.230807 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.231078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.231324 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.231572 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.231814 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.232065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.232333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.232585 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.232835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.233089 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.233326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.233572 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.233810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.234059 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.234310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.234547 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.234801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.235053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.235301 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.235538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.235800 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.236064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.236344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.236597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.236836 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.238115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.238115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.238115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.238115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.238115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.239184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.239184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.239184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.239184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.239184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.240914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.241587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.241587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.241587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.242132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.242132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.242482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.242482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.242856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.243024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.243156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.243385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.243622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.243858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.244094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.244352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.244602 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.244839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.245076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.245308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.245568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.245806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.246554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.246806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.247043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.247314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.247554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.247803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.248051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.248310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.248546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.248781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.249028 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.249265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.249501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.249743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.249979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.250214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.250450 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.250682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.250915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.251174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.251416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.251658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.251893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.252027 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 07:01:40.252189 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.252334 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 07:01:40.252475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] command line args: [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 07:01:40.252603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.252603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.252858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 07:01:40.252858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ================================================================================ {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 07:01:40.253105 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.253245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] admin_token = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.253380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.253517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] config_dir = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.253652 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.253785 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.253913 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.254051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] config_source = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.254185 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.254312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] debug = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.254445 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.254573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.254817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.254949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.254949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.255186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.255319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.255447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.255594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.255724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.255851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.255982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.256115 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_config_append = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.256298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.256436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.256565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.256722 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_dir = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.256722 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_file = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.256968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.external = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.257107 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.257234 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.257361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.257487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.257620 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.257748 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.257883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.258030 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.password = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.258163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.258292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] auth.token = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.258423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.258558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.258694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.258824 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.258957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.259085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.259212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.259338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.259476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.259605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.259741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.259868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.260002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.260235 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.260383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.260518 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.260646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.260773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.260906 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.261068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.261068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.261320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.261448 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.261593 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] publish_errors = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.262455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.262610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.262743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.262871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.262871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.263124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.263124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.263374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.263512 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.263647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.263776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.263912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] standard_threads = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.264048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.264223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.264368 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.264498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.264626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.264626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.264867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.265003 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.265133 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] use_journal = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.265261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.265388 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] use_json = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.265516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.265643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] use_stderr = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.265643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] use_syslog = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.265893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.265893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.266144 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 07:01:40.266272 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.266400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.266536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.266665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.266871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267017 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267677 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267822 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.267951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268281 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268419 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.268957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.269947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270726 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.270990 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271118 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271507 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.271899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272475 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.272875 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273271 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273550 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.273810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274077 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274217 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.274871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275000 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275271 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.275936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276063 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276614 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.276913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.277043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.277187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.277317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.277949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278631 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.278888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279025 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279561 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.279967 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280540 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.280941 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281620 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.281879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.282781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283026 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283432 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283829 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.283966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284619 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.284886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285723 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285852 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.285981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286111 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286239 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286510 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286639 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.286913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.287970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.288909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289295 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289560 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289818 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.289947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290075 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290341 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.290993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.291918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.292772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.293917 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294449 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294709 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.294966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.external = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295231 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295491 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295757 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.295886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.password = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296171 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] auth.token = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] role.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] role.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296844 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.296975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297103 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297359 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.297884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298025 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.298945 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299734 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.299871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300463 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300463 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300704 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.300975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301103 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301359 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.301892 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302149 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302672 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302799 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.302928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303340 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303738 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.303874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.304006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.304181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.304318 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.304849 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.304996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.305936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306324 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.306905 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307034 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307831 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.307960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.308088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.308243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.308386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309323 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309717 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.309994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310124 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310433 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310830 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.310958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311676 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.connection = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.311954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312085 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.312896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313146 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313277 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.313935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.314990 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315661 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315791 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.315920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.316882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.317011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.318080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.319137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.320222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.322351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] role.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.323537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] role.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.324733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.325450 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.325450 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.325704 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.325704 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.325956 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.326173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.326423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.326872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.327314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.327555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.327809 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.328064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.328344 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.328596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.328831 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.329087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.329342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.329583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.329817 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.330052 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.330314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.330565 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.330821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.331071 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.331307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.331544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.331775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.332011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.332272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.332533 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.332753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.333009 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.333258 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.333498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.333746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.333989 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.334235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.334472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.334708 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.334942 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.335190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.335438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.335668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.335910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.336230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.336494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.connection = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.336739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.336986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.337223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.337464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.337698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.337956 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.338166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.338400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.338643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.338786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.338939 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.339076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.339211 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.339359 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.339359 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.339618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.340392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.340716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.341070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.341314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.341552 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 07:01:40.341723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 07:01:40.348183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.371489 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.371821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.371980 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.378011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.378243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.380867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.400249 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.400465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.435715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.438719 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.484386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.484715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.487986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.488243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.550697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.550987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551160 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551339 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551498 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551795 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.551945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.552086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.552086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.552392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.552392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.575658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.575962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576613 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.576962 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577157 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.577752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.588700 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.590076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.602314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.602549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.602753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.603046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.603249 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.603391 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.603579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.603916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.604167 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.604395 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.604617 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.604839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.605053 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.605262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 07:01:40.621734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.621952 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 07:01:40.622462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.622612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.622752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 07:01:40.622899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 07:01:40.623050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.623190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.623344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.623485 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 07:01:40.623623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.623763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.623900 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.624163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.624163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.624440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.634757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.634953 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635116 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635269 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.635826 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.643761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.644208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.647013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.647293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.647455 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.647608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.647749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.647887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648025 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.648898 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649747 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.649892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.650033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.650033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.676671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.677802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.678308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.678594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.679452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.679730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.685840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.686104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.686266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.686410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.686549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.686737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.694086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.694395 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.694540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.694679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.698915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.699285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.699434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.699623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.699781 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.700881 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.701102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.701248 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.701396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.701536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.701673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.720287 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.720590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.721078 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.721373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.725472 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.726233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.729163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.729456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.729911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.730209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.735461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.736522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.739118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.740179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.742916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.743214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.743497 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.743781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744058 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744699 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.744978 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.745260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.745538 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.766207 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.766515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.766759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.767020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.768499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.768809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.769085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.769355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.778002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.779776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.779960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.780112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.781729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.782002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.783310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.783607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.784573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.784873 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.785157 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.785318 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.785461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.785750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.786031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.786308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.799520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.799827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.800149 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.800452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.800655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.800800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.800947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801748 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.801887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.802286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.819310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.820106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.822568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.823330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.826295 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.826665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.827875 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.828269 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.829677 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.829953 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.830101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.830272 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.830416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.830554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.837452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.838042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.839046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.839607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.843051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.843338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.843487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.843628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.843791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.843934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.844073 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.844252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.853609 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.853910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.854196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.854482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.854769 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.855050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.862572 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.862838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.863117 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.863392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.863661 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.863808 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 07:01:40.863959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864723 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.864865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.865004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.865278 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.865551 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.865896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866465 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.866903 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.867044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.867182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.867328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.867469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 07:01:40.906220 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643ffe809c0 pid: 86910 (default app) May 12 07:01:40.906640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643ffe809c0 pid: 86909 (default app) May 12 07:01:40.909743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc48cc-2cee-4a6b-91eb-7bb3202fe369 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:40.910042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc48cc-2cee-4a6b-91eb-7bb3202fe369 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:40.910327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc48cc-2cee-4a6b-91eb-7bb3202fe369 None None] PATH_INFO: `/v3` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:40.914529 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu May 12 07:01:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:01:49.238535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:49.239126 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:49.239126 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:49.243358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:01:49.248856 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:49.249242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:49.249415 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:49.279806 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG oslo_db.sqlalchemy.engines [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 07:01:49.464402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG passlib.handlers.bcrypt [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86910) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 07:01:49.465472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG passlib.handlers.bcrypt [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86910) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 07:01:49.520504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:49.522033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:49.645255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 07:01:49.789648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:49.823018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG oslo_db.sqlalchemy.engines [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 07:01:49.949267 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91adff-1f44-4381-97a7-6f82bcd95eed None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:49.953455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:49.954113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:49.954396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:49.954673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:49.962758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:50.014589 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING keystone.common.rbac_enforcer.enforcer [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 07:01:50.014935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3d4a-20ea-4fe5-bc7f-27f0eb1fdf54 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:50.024207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 12 07:01:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 07:01:50.030759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:50.045901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c737d2-526c-47a6-b25b-341debc523f0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:50.050351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:50.051433 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:50.051721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:50.052011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] PATH_INFO: `/v3/projects/bb9a0833837c452ba8e446c72d6e4378` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:50.053551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb9a0833837c452ba8e446c72d6e4378)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:50.104371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING keystone.common.rbac_enforcer.enforcer [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 07:01:50.104718 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429df4-15c1-47b0-a417-372f5740f5f2 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:50.110000 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu May 12 07:01:50 2022] GET /identity/v3/projects/bb9a0833837c452ba8e446c72d6e4378 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:01:52.494087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824935-d766-4345-9ede-e1559dd04863 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:52.494600 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824935-d766-4345-9ede-e1559dd04863 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:52.494693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824935-d766-4345-9ede-e1559dd04863 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:52.498752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:01:52.504199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:52.504627 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:52.504767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:52.525477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:52.527783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:52.535669 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 07:01:52.558994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea824935-d766-4345-9ede-e1559dd04863 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:52.570999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea824935-d766-4345-9ede-e1559dd04863 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:52.575892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:52.576557 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:52.576845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:52.577123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:52.584808 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:52.586576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5737ce4-5d95-4cf7-9688-9b46129ae37c admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:52.596068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 12 07:01:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 07:01:52.601676 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:52.610537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdaaf-d67b-4afe-a661-d92127252d89 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:52.614944 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:52.615793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:52.616075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:52.616391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:52.617777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:52.619589 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7994f-b1fd-4310-9b6f-53788dfb546e admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:52.621175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu May 12 07:01:52 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:01:54.959256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39656a13-84f6-4cc5-95ba-e5ba72db3fac None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:54.959778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39656a13-84f6-4cc5-95ba-e5ba72db3fac None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:54.959922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39656a13-84f6-4cc5-95ba-e5ba72db3fac None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:54.961386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:01:54.967681 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:54.968140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:54.968273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:54.985092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:54.986254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:55.026148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439dbd-2b9e-4c19-a12d-6023135dd912 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.026446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439dbd-2b9e-4c19-a12d-6023135dd912 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.026843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439dbd-2b9e-4c19-a12d-6023135dd912 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.028169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:01:55.033545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.033835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.034115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.065858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:01:55.073377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG passlib.handlers.bcrypt [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86909) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 07:01:55.074493 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG passlib.handlers.bcrypt [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86909) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 07:01:55.090551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.121248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:55.122842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:55.186986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c75e00-0846-4cad-b4ec-488408399877 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.219876 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.220650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.220943 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.221227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.222175 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:01:55.233205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:01:55.244601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:01:55.246083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:01:55.246896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:01:55.247515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.247590 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:01:55.252176 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.343035 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3baab9-d473-4b3d-8527-63907be658e9 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.356536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558af0d-ec1f-4bca-8513-670b02863f34 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.375618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.376555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.376843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.377123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.392386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.393063 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.393348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.393649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.394390 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:01:55.394693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.396288 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.408587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:01:55.414048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.445965 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.447509 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.510431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058619cd-d330-49f7-8090-edc8aa46b234 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.548027 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:01:55.553786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.655768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.656684 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.656965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.657239 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.658523 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.660023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.661773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:01:55.667475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.767779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d472-250b-48cb-83d9-0628a29efd27 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.771889 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5486-54f9-4d9a-9470-b62c38538e14 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.799155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.799938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.800247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.800541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.801700 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.803135 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.804743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:01:55.805020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.805896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.806191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.806473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.810892 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.826978 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.828483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:01:55.848542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:01:55.849834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:01:55.850837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:01:55.850837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:01:55.850837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:01:55.850837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:01:55.850837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:01:55.855927 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:55.906995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615053-85a6-44f8-beb0-c20933b88929 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.938540 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.939203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.939490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.939775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.940650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.domain.id=default, user.id=1ed0de300758400388e11ebad1cc267a) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:01:55.940970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.942409 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34086bbf-cf83-47a8-b729-486da04841b3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:55.949553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/role_assignments?user.id=1ed0de300758400388e11ebad1cc267a&scope.domain.id=default&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:01:55.952997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f2a3-7c87-48d2-9c06-34c023df33b6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:55.989712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:55.990397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:55.990683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:55.990963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:55.991713 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:01:55.992024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:55.993467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fdcbd-2c2b-49ce-9a9d-cdb06ce0d5a5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:56.013677 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:01:58.865014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61e94-a3aa-4d01-a7e0-9cc5062e052e None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:58.865014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61e94-a3aa-4d01-a7e0-9cc5062e052e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:58.865014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61e94-a3aa-4d01-a7e0-9cc5062e052e None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:58.866723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:01:58.875912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2835fb0-3c3a-4cbf-8233-4064f19d8f3b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:58.876914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2835fb0-3c3a-4cbf-8233-4064f19d8f3b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:58.877401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2835fb0-3c3a-4cbf-8233-4064f19d8f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:58.905580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-c2835fb0-3c3a-4cbf-8233-4064f19d8f3b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:58.907121 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-c2835fb0-3c3a-4cbf-8233-4064f19d8f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:58.997455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:01:59.025508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd61e94-a3aa-4d01-a7e0-9cc5062e052e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.076534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1dd73-8430-4e9e-8e45-9cf75a2b18fc None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.077187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1dd73-8430-4e9e-8e45-9cf75a2b18fc None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.077675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1dd73-8430-4e9e-8e45-9cf75a2b18fc None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.079261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:01:59.096759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036ba3-95ea-4ecb-8ffa-ca7e892ab400 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.097039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036ba3-95ea-4ecb-8ffa-ca7e892ab400 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.097500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036ba3-95ea-4ecb-8ffa-ca7e892ab400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.127461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-23036ba3-95ea-4ecb-8ffa-ca7e892ab400 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:59.128927 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-23036ba3-95ea-4ecb-8ffa-ca7e892ab400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:59.169983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd61e94-a3aa-4d01-a7e0-9cc5062e052e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.206390 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:59.207451 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.207878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.208341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.220729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-8421e35e-4611-49fb-874f-6b2a9504a087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:01:59.232580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:01:59.233623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:01:59.234509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:01:59.237155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 13/25] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:01:59.239033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec2e4-7a67-4473-8f43-12ca63af0d73 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.239485 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec2e4-7a67-4473-8f43-12ca63af0d73 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.239984 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec2e4-7a67-4473-8f43-12ca63af0d73 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.241843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 14/26] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:01:59.242697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ec2e4-7a67-4473-8f43-12ca63af0d73 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.265971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 13/27] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:01:59.268281 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcca8-99ea-4c4e-bba3-276c6de85b47 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.268746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcca8-99ea-4c4e-bba3-276c6de85b47 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.269350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcca8-99ea-4c4e-bba3-276c6de85b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.299390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-52dfcca8-99ea-4c4e-bba3-276c6de85b47 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:59.301268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-52dfcca8-99ea-4c4e-bba3-276c6de85b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:59.361155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ec2e4-7a67-4473-8f43-12ca63af0d73 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.392280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 14/28] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:01:59.394259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18843ba-da52-4765-8fd7-6062d5da62a1 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.394762 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18843ba-da52-4765-8fd7-6062d5da62a1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.395241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18843ba-da52-4765-8fd7-6062d5da62a1 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.397219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 15/29] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:01:59.398189 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18843ba-da52-4765-8fd7-6062d5da62a1 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.405823 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:59.406688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.407134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.407553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.408487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:01:59.408956 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:59.410486 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fa28-455b-4d5d-81a6-4f1083679003 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:59.424879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 15/30] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:01:59.426308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.428484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.428936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.454704 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:01:59.456564 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:01:59.545057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 16/31] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:01:59.545057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.547079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18843ba-da52-4765-8fd7-6062d5da62a1 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.588842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:59.590306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.590501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.590721 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.591479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:59.592920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:59.671227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2f22-8294-4ea5-9050-42686e8f6859 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.705899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:59.707088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.707654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.708179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.718387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:59.720177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:01:59.739272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:01:59.740134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:01:59.740957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:01:59.740957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:01:59.740957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:01:59.740957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:01:59.742934 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 17/32] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:01:59.743902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.753108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 16/33] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 12 07:01:59 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:01:59.754422 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:01:59.920000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43964e-8578-4408-9a68-9979a4b29923 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.949259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cc6a-de1d-4f3d-915d-4877fdc440f8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:01:59.960009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:01:59.961147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:01:59.961678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:01:59.962158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:01:59.963148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:01:59.965737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:01:59.986767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 17/34] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 12 07:01:59 2022] POST /identity/v3/roles => generated 225 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:01:59.987988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:00.005958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.006411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.006689 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.006977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.015593 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.015593 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.017008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 18/35] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:01:59 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:00.025145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:00.142995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d012fe-2655-4f08-9e44-43b7abba03ec None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:00.176545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c97b-5cd4-48bb-a554-e36b82d383e6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:00.182426 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.183437 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.188147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.188147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.188147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.188147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.188929 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 19/36] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:00.195720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:00.260980 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.261637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.261950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.262178 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.262930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:00.263317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.264757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.286527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 18/37] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:00.292194 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:00.332787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32671a62-1bca-4b1c-ac01-52fb4929f8dd None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:00.389111 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.389991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.390271 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.390546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] PATH_INFO: `/v3/domains/default/users/1ed0de300758400388e11ebad1cc267a/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.397257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ed0de300758400388e11ebad1cc267a, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.399090 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7c34-0986-4391-af2b-808748e34f71 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.451444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548161-d89a-428c-8bf0-4e4c8c3a967d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:00.488504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.489563 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.490048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.490539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.491708 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.493403 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99141429-cfea-441e-968b-2c5f4213b51f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.525519 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 19/38] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:02:00 2022] POST /identity/v3/projects => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:02:00.538486 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 20/39] 10.222.0.71 () {58 vars in 1361 bytes} [Thu May 12 07:02:00 2022] PUT /identity/v3/domains/default/users/1ed0de300758400388e11ebad1cc267a/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:00.561662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89a25-7fe6-44a7-9752-d66e3d8d62b7 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.562634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89a25-7fe6-44a7-9752-d66e3d8d62b7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.563387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89a25-7fe6-44a7-9752-d66e3d8d62b7 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.565536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 20/40] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:00.572214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc38d69-0045-4468-9a7d-baebf1d7465b None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.572557 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc38d69-0045-4468-9a7d-baebf1d7465b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.572796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc38d69-0045-4468-9a7d-baebf1d7465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.593923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-dfc38d69-0045-4468-9a7d-baebf1d7465b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:00.595752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-dfc38d69-0045-4468-9a7d-baebf1d7465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:00.679219 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 21/41] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:00.705198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89a25-7fe6-44a7-9752-d66e3d8d62b7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:00.811834 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067fb9-0db9-4cdf-86ce-8dcaf1008962 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.812464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067fb9-0db9-4cdf-86ce-8dcaf1008962 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.812966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067fb9-0db9-4cdf-86ce-8dcaf1008962 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.817322 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 22/42] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:00.818225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89a25-7fe6-44a7-9752-d66e3d8d62b7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:00.822646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.822935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.823217 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.840061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:00.841292 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:00.858553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:00.859228 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:00.859515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:00.859794 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:00.860584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:00.862046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:00.875663 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 21/43] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 12 07:02:00 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:00.913440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 23/44] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:00.937705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:01.052010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32281-7684-4329-9af8-96edc550bd4d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:01.088191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:01.088977 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:01.089279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:01.089566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:01.090809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:01.092322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6ca4a-e67d-4c2b-aa6f-211e11b30223 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:01.094155 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 22/45] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:01.099928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:01.199253 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be9f08-65f7-4bf7-9228-083fc19991b1 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:01.231448 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:01.232107 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:01.232423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:01.232710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:01.233439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:01.235028 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f593e-efda-47fb-8a5e-0a3c585a2262 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:01.261783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:02:01 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:02.929623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c617-7613-4827-8a0d-d91d92812069 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:02.930136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c617-7613-4827-8a0d-d91d92812069 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:02.930645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c617-7613-4827-8a0d-d91d92812069 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:02.934072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 23/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:02.940048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:02.940536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:02.940847 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:02.958431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:02.959752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:03.025006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 25/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:03.051204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c617-7613-4827-8a0d-d91d92812069 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.150648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c617-7613-4827-8a0d-d91d92812069 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.183496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.184417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.184706 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.184987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.196215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:03.205268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:03.206289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:03.207979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 24/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:03.212262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.306182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53241-3231-4018-adf3-de6530dc4dac None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.339933 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.340637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.340926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.341208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.341958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:03.342271 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.343656 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:03.352002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 26/50] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:03.358059 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.460070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a293d9-5273-455f-b98c-670248dbcc81 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.494355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.495228 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.495515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.495902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.497425 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.498901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5c823-d201-4b4b-8f19-4e4a1589ac3a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:03.500569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 25/51] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:03.506035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.595237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6e32-1211-4d5c-87e8-b7ebea2653b7 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.595526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6e32-1211-4d5c-87e8-b7ebea2653b7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.595819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6e32-1211-4d5c-87e8-b7ebea2653b7 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.597233 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 26/52] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:03.601328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8b98-31f0-47fe-a76f-b70b9b044201 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.602559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.602907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.603141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.620022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:03.621573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:03.634589 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.635383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.636212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.636573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.637769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.639219 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:03.640891 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 27/53] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:03.646650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.686181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 27/54] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:03.710992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.759675 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca7dbb-a096-4e3a-947c-1074150d5ad5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.791697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.792501 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.792786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.793064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.793895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.domain.id=default, user.id=1ed0de300758400388e11ebad1cc267a) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:03.794203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.795639 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:03.801236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 28/55] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/role_assignments?user.id=1ed0de300758400388e11ebad1cc267a&scope.domain.id=default&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:03.805092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa11e8-3b77-4f21-a5b8-1cada8ecdca1 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.841824 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.842644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.842932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.843212 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.844508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.846011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4021e-b97e-48e7-b03b-3625533196c6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:03.847687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 28/56] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:03.853828 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:03.958291 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025880-83a5-4434-873e-aa3d6fb8f9af None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:03.995819 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:03.996613 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:03.996896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:03.997175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:03.997908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:03.999371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217ce8-b63f-47ec-9c24-841b763a9196 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:04.027388 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 29/57] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 12 07:02:03 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:06.314023 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040207d-2d70-4aee-bad7-300313bb0003 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:06.314564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040207d-2d70-4aee-bad7-300313bb0003 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:06.314564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040207d-2d70-4aee-bad7-300313bb0003 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:06.315931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 29/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:06.321286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:06.321652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:06.321862 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:06.338565 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:06.340005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:06.404388 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 30/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:06.429582 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040207d-2d70-4aee-bad7-300313bb0003 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:06.527004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040207d-2d70-4aee-bad7-300313bb0003 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:06.558955 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:06.559742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:06.560029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:06.560340 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:06.561515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:06.562971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e06917-3d62-46d8-8cde-8d85ef63b52f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:06.564698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 30/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:06.570180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:06.664698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9158-7e12-4aef-a1f8-3cc327b12c3e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:06.696878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:06.697530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:06.697811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:06.698118 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:06.698995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:06.700459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520634d-9f49-4780-9abf-be3b8531aa97 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:06.725280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 31/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:06 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:10.301378 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b194a-901e-4f8e-83b2-659698417c7f None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.302289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b194a-901e-4f8e-83b2-659698417c7f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.302740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b194a-901e-4f8e-83b2-659698417c7f None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.304337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 31/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:10.310573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.311421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.311873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.332725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:10.334208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:10.399488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3234-d7d0-4c90-a355-8d35c8c53506 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.400155 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3234-d7d0-4c90-a355-8d35c8c53506 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.400651 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3234-d7d0-4c90-a355-8d35c8c53506 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.402650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 32/63] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:10.407583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.408093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.408609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.418889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 32/64] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:10.428257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:10.429761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:10.461283 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.530582 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 33/65] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:10.566422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbbb9b-9eee-437b-b81b-e64e5f043867 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:10.574907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.603215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:10.605047 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.605503 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.605934 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.617358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-ec05ef7b-feac-4705-97cf-af912f7661af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:10.625946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:10.627005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:10.627948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:10.630289 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 33/66] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:10.631675 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669afab-0913-493f-9162-1d909492ba20 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.632139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669afab-0913-493f-9162-1d909492ba20 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.632559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669afab-0913-493f-9162-1d909492ba20 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.634233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 34/67] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:10.635508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669afab-0913-493f-9162-1d909492ba20 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.680530 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8da76-d5f9-465b-b7f6-9e5140d5a2a4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:10.713937 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:10.714759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.715044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.715322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.725598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-818bd237-8b5c-4da4-98cb-b768195a499f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:10.734578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:10.735520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 34/68] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:10.741131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.741819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.741819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.748980 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669afab-0913-493f-9162-1d909492ba20 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:10.757045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:10.758285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:10.791352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:10.792932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.793393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.793801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.794992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:10.795481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:10.797740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ba775-7dc7-463c-a132-eea6d1c6dd2d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:10.810926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 35/69] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:10.812218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9b79-1ba6-4adc-830b-4b0a5bb55369 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.812536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9b79-1ba6-4adc-830b-4b0a5bb55369 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.812858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9b79-1ba6-4adc-830b-4b0a5bb55369 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.816394 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 36/70] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:10.817422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9b79-1ba6-4adc-830b-4b0a5bb55369 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.831842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 35/71] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:10.832981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.933642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9b79-1ba6-4adc-830b-4b0a5bb55369 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:10.935294 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909eae-b949-4d05-87b9-802f428a7f54 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:10.966537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:10.967208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.967497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.967780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.967940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:10.968573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:10.968838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.968940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:10.969123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.969395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.970274 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66fe6f-11d3-4694-8662-ab6e1dfd7578 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:10.978421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 37/72] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:10.981465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319c6b-d1b7-4b17-84f5-aacb2fb134df None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:10.981758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319c6b-d1b7-4b17-84f5-aacb2fb134df None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:10.982034 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319c6b-d1b7-4b17-84f5-aacb2fb134df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:10.985022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:10.986496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:10.988280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:10.989054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:10.998383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-16319c6b-d1b7-4b17-84f5-aacb2fb134df None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:10.999569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-16319c6b-d1b7-4b17-84f5-aacb2fb134df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:11.063101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 38/74] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:11.064939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23907-a1dc-43ca-a55e-869d178e9ed7 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.065215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23907-a1dc-43ca-a55e-869d178e9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.065492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23907-a1dc-43ca-a55e-869d178e9ed7 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.066948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 39/75] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:11.067519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b23907-a1dc-43ca-a55e-869d178e9ed7 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.098433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a584-78fc-42ab-bca7-4d26aa5108e9 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.131105 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.131910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.132229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.132513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.142778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:11.150778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:11.153317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 37/76] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:11.154106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.175138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b23907-a1dc-43ca-a55e-869d178e9ed7 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.207183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.208048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.208357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.208634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.209814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.211255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b751a-3f51-4b09-b928-f648bd3bd3c6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.213122 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 40/77] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:11.214913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.215187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.215465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.231384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:11.232600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:11.254297 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a185d-b563-4ac9-9103-2d0aa1003ace None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.286821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.287474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.287760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.288047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.294919 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 41/78] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:11.296922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.353484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.355012 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.392187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861704-b435-4f61-a57d-09997dae9b4d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.425655 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.426441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.426724 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.427000 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.428181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.429616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.436285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 42/79] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:11.436285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.453975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 38/80] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:11.460263 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.530708 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e9567-d662-4eef-9c08-bb98d44b2252 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.555659 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455f5e-47bf-4d03-a5bd-f6dcc9110046 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.563675 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.564376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.564667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.564957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.565710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:11.566020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.567403 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.575382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 43/81] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:11.576207 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.590136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.590790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.591168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.591461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.654593 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.656044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.670268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c58e65-ee8b-4acf-ba89-b6dd97fd74e0 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.702598 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.703387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.703676 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.703959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.714157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:11.721790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:11.722637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:11.723670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 44/82] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:11.724893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.753331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 39/83] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:11.754186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.819171 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a94980-5039-4e2e-9356-4e32f0fe7c32 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.848027 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1743292-a25e-42c8-8672-1c49f157919b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:11.851266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.851932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.852247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.852531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.853250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.855008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.873949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 45/84] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:11 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:11.874768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.891496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:11.892492 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:11.892784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:11.893065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:11.894379 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:11.895934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:11.898022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 40/85] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:11.905421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:11.985679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c781-0be7-4a0f-aa62-90bd7c6d4925 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.015150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47d12b-7dcf-407d-985b-768f130e623f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.020587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.021512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.021802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.022087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.023367 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.024914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.032066 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 46/86] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.032066 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.054052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971876-8769-460c-9425-4631510b9e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.054743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971876-8769-460c-9425-4631510b9e7a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.055031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971876-8769-460c-9425-4631510b9e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.055311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971876-8769-460c-9425-4631510b9e7a None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.056451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971876-8769-460c-9425-4631510b9e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:12.056451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971876-8769-460c-9425-4631510b9e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.057874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971876-8769-460c-9425-4631510b9e7a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.070622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 41/87] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.071813 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971876-8769-460c-9425-4631510b9e7a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.134138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d6805-f998-442e-8b7b-4d1e872f2a2f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.170374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.171173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.171463 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.171746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.173095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.174600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.176740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 47/88] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.176857 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971876-8769-460c-9425-4631510b9e7a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.177541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.212416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.213087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.213417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.213742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.214768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:12.215089 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.216632 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.225576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 42/89] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=b781ae4ae48046a1a9650d001916004e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.226480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.286709 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d33c7-9efe-408a-9e27-6c8a520b5833 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.323234 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.323993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.324364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.324649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.334280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf29c9-9fb4-4ce2-81d8-376d94d9910d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.371331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.372282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.372574 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.372866 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.374155 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.375667 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.377746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 43/90] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.378614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.402006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.403551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.486248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146a7b-f05f-4fa8-9b61-d744bc62dc3e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.511282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 48/91] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:12.512141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.522086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.522761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.523056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.523338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.524216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] RBAC: Adding query filter params (role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:12.524538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.526589 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.533579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 44/92] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.534529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.622127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a681d-62d1-467d-9d2a-0d1db387d399 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.643757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35e90-a409-4839-abce-3b9253c3d124 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.658968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.659957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.660272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.660598 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.680231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.681117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.681408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.681694 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.683443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.684989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.686761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 45/93] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:12.692751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.733475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.734981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.800456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9971-6127-4a32-b547-d1c66d04a0b7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:12.836600 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:12.837287 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:12.837579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:12.837864 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:12.838796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 49/94] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:12.838963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=1ed0de300758400388e11ebad1cc267a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:12.839464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:12.840982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:12.844702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:12.847530 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 46/95] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/role_assignments?user.id=1ed0de300758400388e11ebad1cc267a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:12.968474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfba40-ebc0-48c5-9310-00ed38b67e68 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:13.007473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:13.008384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:13.008667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:13.008952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] PATH_INFO: `/v3/projects/532cf27f1d0d413796acf90e9684d27e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:13.011183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] RBAC: Authorizing `identity:get_project(project_id=532cf27f1d0d413796acf90e9684d27e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:13.012748 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75338efb-1d45-480a-8b87-8b023b6f553d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:13.014614 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 50/96] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:12 2022] GET /identity/v3/projects/532cf27f1d0d413796acf90e9684d27e => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:13.020645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:13.154330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744a08-3f0a-475f-a17e-16f34dcefce3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:13.190869 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:13.191538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:13.191831 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:13.192134 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:13.192992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=532cf27f1d0d413796acf90e9684d27e, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:13.193312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:13.194775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b049-2de3-4f39-8bbd-0adbe431ff59 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:13.200463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 47/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:13 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=532cf27f1d0d413796acf90e9684d27e&role.id=b781ae4ae48046a1a9650d001916004e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:15.200544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e791-8eea-47cf-8374-99335a107105 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:15.201163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e791-8eea-47cf-8374-99335a107105 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:15.201408 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e791-8eea-47cf-8374-99335a107105 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:15.203160 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 51/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:15.208737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:15.209152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:15.209346 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:15.233180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:15.234408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:15.321944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 48/99] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:15.361696 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e791-8eea-47cf-8374-99335a107105 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:15.488640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e791-8eea-47cf-8374-99335a107105 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:15.531636 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:15.532467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:15.532752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:15.533029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:15.549198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:15.557189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:15.558374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:15.559329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:15.563140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 52/100] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:15.564576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:15.705102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0f5e-7644-4ec0-bd95-54095f93de85 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:15.743747 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:15.744384 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:15.744936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:15.745224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:15.746049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:15.746369 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:15.747774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:15.756531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 49/101] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:15.764481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:15.899940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735fd73-efb9-415e-930f-b4ddb4ffa2f8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:15.939708 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:15.940621 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:15.940909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:15.941191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] PATH_INFO: `/v3/users/3ac46a123d4a43e69059399bc1b4474b` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:15.961064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] RBAC: Authorizing `identity:get_user(user_id=3ac46a123d4a43e69059399bc1b4474b)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:15.962599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf3f2-7682-4f91-8cc2-10536950c6ce None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:15.965290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 53/102] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:15 2022] GET /identity/v3/users/3ac46a123d4a43e69059399bc1b4474b => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:15.971164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.103964 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a11d27-95da-41b6-97cd-6091708393d0 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.104165 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a11d27-95da-41b6-97cd-6091708393d0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.104460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a11d27-95da-41b6-97cd-6091708393d0 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.107355 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 54/103] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:16.111581 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876ac0-fdb4-4f2d-8ea7-9a41c3819e0d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.111870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876ac0-fdb4-4f2d-8ea7-9a41c3819e0d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.112183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876ac0-fdb4-4f2d-8ea7-9a41c3819e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.118637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920aadf-c9e8-4c31-95d9-750b9a5c23c0 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.148372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4b876ac0-fdb4-4f2d-8ea7-9a41c3819e0d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:16.149604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4b876ac0-fdb4-4f2d-8ea7-9a41c3819e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:16.162106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.163426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.163723 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.164067 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.242010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 55/104] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:16.243845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:16.246660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b670a-4b2d-441b-b9ff-a69ab02933f6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:16.249515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9d74-e2ff-4535-997b-8aaf3363747d None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.249966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9d74-e2ff-4535-997b-8aaf3363747d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.250411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9d74-e2ff-4535-997b-8aaf3363747d None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.251908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 56/105] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:16.253399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca6425-3e4a-42a5-be39-5d4a1177ba49 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.253916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca6425-3e4a-42a5-be39-5d4a1177ba49 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.254391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca6425-3e4a-42a5-be39-5d4a1177ba49 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.260475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 57/106] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:16.262104 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.262615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.263209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.293137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:16.294656 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:16.353589 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 50/107] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:16.355922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.356404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.356841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.366698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 58/108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:16.368064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.374441 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:16.375630 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:16.449383 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 51/109] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:16.450082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.475715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b83d-5d26-42bf-ad66-a9a4475c9a56 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.516108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.516953 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.517236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.517519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.531366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-63469b6b-6e4a-4c6e-ab72-f647a3464243 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:16.539086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:16.539960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:16.540839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 59/110] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:16.545510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0973ad-002a-409a-b083-d14212352ee4 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.546061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0973ad-002a-409a-b083-d14212352ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.546355 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0973ad-002a-409a-b083-d14212352ee4 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.547871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 60/111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:16.548440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0973ad-002a-409a-b083-d14212352ee4 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.561047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3a82-cbae-4fdd-acfa-cfc63d81ab0c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.595037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.595908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.596226 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.596504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.597708 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:16.599446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:16.601360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 52/112] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:16.601959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.659525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0973ad-002a-409a-b083-d14212352ee4 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.694325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.695131 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.695422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.695704 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.704261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493fc6-db53-4472-b668-582627f8fbbf None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.705787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:16.714114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:16.715162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:16.715941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 61/113] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:16.716615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.739758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.740601 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.740889 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.741169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.751354 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-8eb067d5-205d-4dbb-9b60-bcab35d42a62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:16.759187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:16.760556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 53/114] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:16.761942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.762810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.762810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.778876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:16.780057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:16.817556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd549e-9be1-4eb3-bf10-d1c4f813d97b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.843679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 54/115] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:16.844550 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.849805 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.850477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.850813 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.851094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.851903 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:16.852250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:16.853690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b384-59d6-4b0d-b9a6-a1afe06ad982 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:16.862253 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 62/116] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:16.868289 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f325f-0946-4cf8-b293-527e536465c2 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.868588 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f325f-0946-4cf8-b293-527e536465c2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.868878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f325f-0946-4cf8-b293-527e536465c2 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.870876 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 63/117] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:16.871650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f325f-0946-4cf8-b293-527e536465c2 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:16.938804 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1d9e-6ab1-4f9a-b362-e80f444c1c1b None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.970026 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f325f-0946-4cf8-b293-527e536465c2 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:16.971289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:16.971947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:16.972256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:16.972534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:16.973370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=3ac46a123d4a43e69059399bc1b4474b) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:16.973934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:16.975397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:16.981124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 55/118] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/role_assignments?user.id=3ac46a123d4a43e69059399bc1b4474b&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:16.981698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.020634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.021438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.021730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.022018 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.022793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:17.023110 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.024564 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.033828 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 64/119] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.034522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.095571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0b85-2814-4238-948a-14927dea1062 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.141292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.141966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.142498 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.142498 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.143270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:17.143625 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.145007 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.148272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599c98-5bb4-4091-8e80-5abd7c7ff80c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.159412 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 56/120] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.159412 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.184972 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.185857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.186142 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.186418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.187622 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.189171 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc809a53-6396-43d4-8e80-fa8861fee382 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.190909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 65/121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.191887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.192254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.192471 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.209472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:17.210991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:17.269453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885196-5a00-4989-966c-99d8adb417f1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.288184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 66/122] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:17.289812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.308218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.309039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.309430 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.309718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.310947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.312459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.314237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 57/123] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.318811 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.393091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eb00-6e4a-482f-ad9b-25854f05caaf None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.417138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125df68-5537-4398-9bd2-6f87044c8106 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.428097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.429012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.429295 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.429568 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.430770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.432819 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.434808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 67/124] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.435601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.458439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.459244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.459531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.459813 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.461048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.462649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.464573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 58/125] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.464573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.547264 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2146a3-9715-4008-974f-7d45fd6a3c28 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.568622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a616-281f-4e0f-bb77-d73bf716c6c3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.581422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.582280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.582560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.582851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.584020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.585511 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.587383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.590055 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.601760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.602558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.602844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.603122 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.614108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:17.622605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:17.629203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 59/127] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:17.630213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.700870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad562590-4774-462e-8111-3aa4125e5314 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.725173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b330-82a5-4c33-8025-694c6772d7d7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.735211 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.736025 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.736468 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.736833 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.737645 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.739198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.761564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.762491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.762782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.763107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.764377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.772312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 69/128] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:02:17 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:17.772312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.772576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.772576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 60/129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.772576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.881665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8725a7-f6ff-4413-acbf-dd5321de297b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.883320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c451e3-7f70-4f1f-9666-abeafc0c2e1a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:17.920433 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.921424 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:17.921551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.921819 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.922159 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] PATH_INFO: `/v3/projects/532cf27f1d0d413796acf90e9684d27e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.922594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:17.922948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:17.923296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/1ed0de300758400388e11ebad1cc267a/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:17.923710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] RBAC: Authorizing `identity:get_project(project_id=532cf27f1d0d413796acf90e9684d27e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.925303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.925613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, user_id=1ed0de300758400388e11ebad1cc267a, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:17.927153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:17.932156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 70/130] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/projects/532cf27f1d0d413796acf90e9684d27e => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:17.933494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:17.946904 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 61/131] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:17 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/1ed0de300758400388e11ebad1cc267a/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:17.949181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:18.055076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85c50-061e-4340-8972-f65671268f8c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.066630 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66e60-70a5-43fe-8580-63941058a570 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.094036 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.095064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.095525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.095978 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.096942 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:18.097421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.099267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.106380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.107344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.107697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.108238 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/95cef57c50c74ad2826ae4ae2ce66503` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.110706 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, user_id=c810e0311f9b44caa0b36ea9ab0e2a2a, role_id=95cef57c50c74ad2826ae4ae2ce66503)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.111354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 71/132] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:18.115906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.116992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:18.133073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 62/133] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:17 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/95cef57c50c74ad2826ae4ae2ce66503 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:18.135679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:18.240738 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9e9d-b909-4336-aed3-0c3ac365d7f8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.266454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192f3e-df69-49f9-867f-6f75711fa199 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.279125 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.280214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.280600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.280904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] PATH_INFO: `/v3/projects/532cf27f1d0d413796acf90e9684d27e/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.283024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] RBAC: Authorizing `identity:create_grant(project_id=532cf27f1d0d413796acf90e9684d27e, user_id=c810e0311f9b44caa0b36ea9ab0e2a2a, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.285364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.302019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 72/134] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:18 2022] PUT /identity/v3/projects/532cf27f1d0d413796acf90e9684d27e/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:18.310704 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.312471 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.312973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.313594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.315255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.317207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.319838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 63/135] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:18 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:18.326692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:18.448242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583601a-a599-47f2-8a41-88a25f2e0e84 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.482221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.483101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.483384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.483663 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.484957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.486499 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd9e3-d2d3-4971-89aa-5a8b8745e3a4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.488421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 73/136] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:18 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:18.494215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:18.603186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc77f-effe-4b5c-a5f3-b4225152b1fc None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:18.638404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:18.639307 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:18.639594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:18.639877 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:18.642033 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, user_id=c810e0311f9b44caa0b36ea9ab0e2a2a, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:18.643500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc339-968b-4926-ae77-81dc3ef0ffbe None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:18.659654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 64/137] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:18 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/c810e0311f9b44caa0b36ea9ab0e2a2a/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:19.912313 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab7177-22d2-431f-8b6b-65eb83d0b913 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:19.912825 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab7177-22d2-431f-8b6b-65eb83d0b913 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:19.913001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab7177-22d2-431f-8b6b-65eb83d0b913 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:19.914394 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 74/138] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:19.919833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:19.920253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:19.920435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:19.945380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:19.946688 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:20.031724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 65/139] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:20.065416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab7177-22d2-431f-8b6b-65eb83d0b913 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:20.201874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab7177-22d2-431f-8b6b-65eb83d0b913 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:20.250039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:20.250850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:20.251196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:20.251483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:20.267563 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:20.280158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:20.281002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:20.281773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:20.289651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 75/140] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:20.297204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:20.476052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb061d-697a-4b54-b718-94f573ff34b1 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:20.517859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:20.518540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:20.518823 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:20.519103 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:20.519855 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:20.520193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:20.521578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:20.535570 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 66/141] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:20.542023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:20.672787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5cc3-4823-4560-a85c-a540cb519468 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:20.708286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:20.709155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:20.709445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:20.709729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] PATH_INFO: `/v3/users/3ac46a123d4a43e69059399bc1b4474b` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:20.710945 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] RBAC: Authorizing `identity:get_user(user_id=3ac46a123d4a43e69059399bc1b4474b)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:20.712491 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:20.715773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 76/142] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:20 2022] GET /identity/v3/users/3ac46a123d4a43e69059399bc1b4474b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:20.722106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:20.874270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc2d2-00fd-4b7f-a19b-87d3fa09bce4 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:20.918662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:20.919539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:20.919823 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:20.920098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:20.921377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:20.922832 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95009e9c-e327-42ad-97b3-819d0c71565b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:20.924556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 67/143] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:20 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:20.930318 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:21.057647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f03c-a41e-41b2-a48c-92f6b563839d None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:21.095440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:21.096388 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.096676 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.096957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/3ac46a123d4a43e69059399bc1b4474b/roles/fa7a0d3b4bf34a32951076f482e9d33a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.099202 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, user_id=3ac46a123d4a43e69059399bc1b4474b, role_id=fa7a0d3b4bf34a32951076f482e9d33a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:21.100741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d764ad-00cd-488b-a348-ff3bb877395a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:21.117721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 77/144] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:20 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/users/3ac46a123d4a43e69059399bc1b4474b/roles/fa7a0d3b4bf34a32951076f482e9d33a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:21.378252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b879386-88f8-4bae-961b-e2f0c784b0ba None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.378538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b879386-88f8-4bae-961b-e2f0c784b0ba None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.378823 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b879386-88f8-4bae-961b-e2f0c784b0ba None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.380206 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 68/145] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:21.387484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48617-d910-4efd-8289-8c4925fea104 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.387920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48617-d910-4efd-8289-8c4925fea104 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.388341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48617-d910-4efd-8289-8c4925fea104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.407740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-eab48617-d910-4efd-8289-8c4925fea104 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:21.409089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-eab48617-d910-4efd-8289-8c4925fea104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:21.485068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 78/146] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:21.514031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b879386-88f8-4bae-961b-e2f0c784b0ba None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:21.620520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f520-21be-427e-973a-adee637e5bb0 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.621349 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f520-21be-427e-973a-adee637e5bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.622196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f520-21be-427e-973a-adee637e5bb0 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.623884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 79/147] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:21.630490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ca8d-bce8-44f1-a0e7-648b265fe46e None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.631183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ca8d-bce8-44f1-a0e7-648b265fe46e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.631969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ca8d-bce8-44f1-a0e7-648b265fe46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.645751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b879386-88f8-4bae-961b-e2f0c784b0ba None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:21.657865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-0118ca8d-bce8-44f1-a0e7-648b265fe46e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:21.659371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-0118ca8d-bce8-44f1-a0e7-648b265fe46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:21.700253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:21.701137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.701432 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.701689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.702925 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:21.708163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:21.708163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 69/148] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:21.711588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:21.766625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 80/149] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:21.768777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61173-e33b-42cf-88df-4f78d0889f5b None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.769327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61173-e33b-42cf-88df-4f78d0889f5b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.769812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61173-e33b-42cf-88df-4f78d0889f5b None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.771387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 81/150] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:21.777652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.778213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.778686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.804775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:21.806314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:21.842679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e4ea4-7bfc-47b9-8afa-0aac77de8283 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:21.877511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:21.878202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:21.878491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:21.878767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:21.879478 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:21.881016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:21.915392 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 70/151] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:21 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:21.918288 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:21.960704 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 82/152] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:22.014098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.102467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c1fe-a39e-43f9-8142-bf0e79baf370 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.182543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaba30-6c9c-4ab6-9f1b-7be36de581d3 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.185376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.186481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.187022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.187500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.225108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:22.234529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:22.235443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:22.245945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:22.246546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.246546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.246546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.246546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.249205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 71/153] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:22.257976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.271297 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:22.285993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:22.286908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:22.287659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:22.288258 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 83/154] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:22.295438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.417861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814842-1403-4dcf-a412-1a1ed9b3987f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.418074 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbb7ae-f94d-419e-be62-bf53ce85d72f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.454492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.455169 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.455460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.455726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.456782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:22.457094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.458483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe0bb4-0172-4735-8bc0-252dc815d1a7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.468663 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.469345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 84/155] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:22.469902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.470378 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.470658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8103f3-8a59-452f-958f-b0161d6cf802 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.470916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8103f3-8a59-452f-958f-b0161d6cf802 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.471196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8103f3-8a59-452f-958f-b0161d6cf802 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.471541 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.472467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 85/156] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:22.472803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:22.473311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.473530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896393c-ba16-4ad8-88c6-2e9c3e44bbf1 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.474143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896393c-ba16-4ad8-88c6-2e9c3e44bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.474427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896393c-ba16-4ad8-88c6-2e9c3e44bbf1 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.475476 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d88bf-293a-4f2c-a0c3-c871e187bede None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.475838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 86/157] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:22.480496 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896393c-ba16-4ad8-88c6-2e9c3e44bbf1 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.489480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 72/158] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:22.490869 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6827-eab1-44a7-8dbb-65d7762c2f16 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.491158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6827-eab1-44a7-8dbb-65d7762c2f16 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.491436 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6827-eab1-44a7-8dbb-65d7762c2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.508352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-be9e6827-eab1-44a7-8dbb-65d7762c2f16 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:22.509553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-be9e6827-eab1-44a7-8dbb-65d7762c2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:22.595521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 73/159] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:22.596881 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.597173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.597464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.599880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896393c-ba16-4ad8-88c6-2e9c3e44bbf1 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.617741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:22.618919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:22.639726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.640643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.640929 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.641209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.642432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.643914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.645675 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 87/160] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:22.646443 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.706679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 74/161] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:22.707857 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.767989 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9a29-14f4-422e-98c2-1ee6afc9edb4 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.804281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.805222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.805508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.805786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] PATH_INFO: `/v3/users/1ed0de300758400388e11ebad1cc267a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.807656 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed0de300758400388e11ebad1cc267a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.809138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.810101 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516b5b-3cf5-4338-afd1-5d96a24c21df None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.811105 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 88/162] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/users/1ed0de300758400388e11ebad1cc267a => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:22.812002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.846722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.847815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.848313 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.849009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.859702 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:22.867775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:22.868738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:22.870214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:22.872593 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 75/163] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:22.874806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.929372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389205d-c9b3-435a-9634-4f4d041a5b50 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.968282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.969015 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.969263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.969547 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.989202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd93f6-f79c-466b-95d1-fbdad6cb591f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.025104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.026379 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.026872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.027338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.037883 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:23.043720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.045278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:23.047715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:23.048683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:23.049675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:23.052168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 76/164] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:23.053382 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.152338 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 89/165] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:23.153342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.160065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa957a4-114b-42cc-b93e-4d70972c93d3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.195888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.196882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.197503 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.197986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.268386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.270137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.295824 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc492-fe35-4ff3-bf49-715349fd7fe6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.369572 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 77/166] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:23.370836 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.376555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.377244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.377525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.377801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.378564 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:23.378871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.380474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.390441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 90/167] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.391607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.565362 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2008-62b0-46f7-ac31-a4b46925632b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.599973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b09e-e1aa-4704-bd7a-2231d1e36171 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.641782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.642651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.642926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.643199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] PATH_INFO: `/v3/projects/532cf27f1d0d413796acf90e9684d27e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.644498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] RBAC: Authorizing `identity:get_project(project_id=532cf27f1d0d413796acf90e9684d27e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.645946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.647765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 91/168] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/projects/532cf27f1d0d413796acf90e9684d27e => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.649681 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.651411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.652100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.652604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.652890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.653732 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:23.654049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.655429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.666136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 78/169] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.667299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.783333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38289f-817c-4fe0-b45f-901686cf9629 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.821935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159202-116b-4cad-a777-a75acc007659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.823659 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159202-116b-4cad-a777-a75acc007659 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.823948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159202-116b-4cad-a777-a75acc007659 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.824258 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159202-116b-4cad-a777-a75acc007659 None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.825507 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76159202-116b-4cad-a777-a75acc007659 None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.827435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76159202-116b-4cad-a777-a75acc007659 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.829595 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 79/170] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.830212 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159202-116b-4cad-a777-a75acc007659 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.868990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377e52-eb28-4450-a859-8e6b3b2c21c2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.942443 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.943317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.943601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.943882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.945120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.945909 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159202-116b-4cad-a777-a75acc007659 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.946557 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.952005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 92/171] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.952864 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.981910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.982583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.982868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.983148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.983991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=532cf27f1d0d413796acf90e9684d27e, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:23.984330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.985791 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.991882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 80/172] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=532cf27f1d0d413796acf90e9684d27e&role.id=b781ae4ae48046a1a9650d001916004e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:23.992729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.107847 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe1b-de15-4794-99fa-26cbf60ef234 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.111911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2951f-c0b8-42cd-ac62-1ebf7a56691c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.144357 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.145029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.145316 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.145598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.161497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.162364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.162641 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.162909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] PATH_INFO: `/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.164100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] RBAC: Authorizing `identity:get_user(user_id=c810e0311f9b44caa0b36ea9ab0e2a2a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.165805 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.167493 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 93/173] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/users/c810e0311f9b44caa0b36ea9ab0e2a2a => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:24.168466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.218255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.219755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.273799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f475-d359-4cde-b91a-c6ffb72d3c6b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.310137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.310805 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.311081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.311351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.312224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=1ed0de300758400388e11ebad1cc267a) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:24.312536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.314453 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.321084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 94/174] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/role_assignments?user.id=1ed0de300758400388e11ebad1cc267a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:24.322016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.327459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 81/175] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:24.333223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.449720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960b86-1e60-4d59-af2f-01f3c3c627a4 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.473310 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ecb1-e094-495f-ab31-bf34514bd29d None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.498243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.499121 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.499406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.499687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.504875 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.506377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.508487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 82/176] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:24.515079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.518329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.518988 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.519266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.519539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.592887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.594362 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.655818 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35813-2f1c-4d93-b588-cbf45d9276eb None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.701701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 95/177] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:24.706799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.712040 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.712870 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.713653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.714127 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.715185 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:24.715504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.716992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.734811 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 83/178] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=b781ae4ae48046a1a9650d001916004e => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:24.816257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f5c1-f2b3-4f57-b548-a2c4b50bb65c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:24.855127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:24.855990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:24.856291 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:24.856562 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:24.857774 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:24.859230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4dde9-2885-4b4d-ae18-164e4483c779 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:24.861101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 96/179] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:24.867128 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:24.970375 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04be76-ffa2-4545-9742-30a583403a4f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:25.007735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:25.008444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.008722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.009003 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.009905 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] RBAC: Adding query filter params (role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=c810e0311f9b44caa0b36ea9ab0e2a2a) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:25.010214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:25.011729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ed291-9f63-47d3-a8aa-42f6b17ca53d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:25.021746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 84/180] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:24 2022] GET /identity/v3/role_assignments?user.id=c810e0311f9b44caa0b36ea9ab0e2a2a&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:25.311583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433786d-cca5-4820-b404-6e41e38af01d None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.312290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433786d-cca5-4820-b404-6e41e38af01d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.312290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433786d-cca5-4820-b404-6e41e38af01d None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.313730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 97/181] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:25.318657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.319183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.319183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.339944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:25.341149 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:25.419395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 85/182] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:25.448882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433786d-cca5-4820-b404-6e41e38af01d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:25.571317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433786d-cca5-4820-b404-6e41e38af01d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:25.608693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:25.609542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.609820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.610093 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.621497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:25.630428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:25.632526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:25.634418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 98/183] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:25.640057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:25.754260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0c1bb-90dc-456f-98ad-73a945406515 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:25.790922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:25.791657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.791941 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.792244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.793026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:25.793332 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:25.794778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:25.804688 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 86/184] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:25.811209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:25.916387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6963-4442-4b8c-a671-545e4f7ed6ab None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:25.951659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:25.952570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.952851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.953126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] PATH_INFO: `/v3/users/3ac46a123d4a43e69059399bc1b4474b` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.954343 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3ac46a123d4a43e69059399bc1b4474b)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:25.955802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574ce3e-7ac1-4052-bb73-adb2ce59c6e7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:25.957491 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 99/185] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:25 2022] GET /identity/v3/users/3ac46a123d4a43e69059399bc1b4474b => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:25.963760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:25.991731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042dacd-9917-4d6b-85ae-3eb1bd82d08a None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:25.992036 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042dacd-9917-4d6b-85ae-3eb1bd82d08a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:25.992334 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042dacd-9917-4d6b-85ae-3eb1bd82d08a None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:25.993709 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 100/186] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:26.000061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.000400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.000686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.017846 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:26.019122 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:26.067633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168175a-9e7b-4716-861e-859a8f1298fb None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.096462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 101/187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:26.102223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.102876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.103154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.103483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.118151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.170764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.172179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.222663 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90553b9-1272-49eb-a373-41063bab7dea None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.257916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.258711 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.258995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.259273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.271574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:26.279939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:26.282095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:26.284049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:26.285518 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 87/188] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:26.285660 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 102/189] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:26.285795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.287087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.390862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b871-2976-4e24-962a-6b32096dc3bb None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.392895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a64da7-955c-4a88-bfad-cbf4a320ab69 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.428153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.428758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.429044 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.429325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.430072 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:26.430380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.434848 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.435010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.435010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.435010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.435010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.435950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.437444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb998856-2edf-4271-b5d7-1df0e0ab2104 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.439687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 88/190] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:26.442780 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeadb-5608-4885-9825-04a793723eec None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.442780 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeadb-5608-4885-9825-04a793723eec None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.442780 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeadb-5608-4885-9825-04a793723eec None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.442780 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 89/191] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:26.444902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aeadb-5608-4885-9825-04a793723eec None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.445617 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 103/192] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:26.451098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.552024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aeadb-5608-4885-9825-04a793723eec None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.552373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb12e-2d3b-4c96-bef1-abaae41f83f7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.583226 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.583460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.583876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.584178 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.584364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.584456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.584649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.584927 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.585259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, scope.project.id=cc56a2c8a6074cb48204eace1d91657d, user.id=3ac46a123d4a43e69059399bc1b4474b) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:26.585566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.587159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6710e5-4e9f-4e73-91ec-3838d3d7b3c4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.593545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 90/193] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/role_assignments?user.id=3ac46a123d4a43e69059399bc1b4474b&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:26.594711 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07fa9-807a-417b-9772-73a89e3ff95f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.594992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07fa9-807a-417b-9772-73a89e3ff95f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.595265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07fa9-807a-417b-9772-73a89e3ff95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.598960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.600479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f6579-acc1-40c2-8327-e3d3be9e1eb2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.607482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 104/194] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:26.607482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed967548-aa04-4f43-afc3-d7e5d4c39204 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.607482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed967548-aa04-4f43-afc3-d7e5d4c39204 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.607482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed967548-aa04-4f43-afc3-d7e5d4c39204 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.607482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 105/195] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:26.613078 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed967548-aa04-4f43-afc3-d7e5d4c39204 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.614061 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-63c07fa9-807a-417b-9772-73a89e3ff95f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:26.615279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-63c07fa9-807a-417b-9772-73a89e3ff95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:26.694006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 91/196] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:26.695148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.695447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.695729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.714983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:26.716333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:26.732997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed967548-aa04-4f43-afc3-d7e5d4c39204 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.771829 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.772540 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.772818 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.773094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.789072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 92/197] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:26.790062 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.854986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:26.854986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:26.898144 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7dbf1-4680-4bcf-83f3-f2ae47b1e53c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:26.931595 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:26.932450 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:26.932738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:26.933017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:26.942738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:26.951423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:26.952362 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:26.953141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 93/198] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:26.954036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:26.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 106/199] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:26.959048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.051114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0754-8874-4524-afc8-1040cd26a164 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.053025 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b985ec-e1bf-4c50-bc4d-61878fafb683 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.084843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.085642 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.085847 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.085956 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.086181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.086534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.086814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.087084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.087355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.088438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:27.088746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.089575 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.090099 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.091364 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 94/200] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:27.091958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.101738 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 107/201] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:27.104020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.187026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07fe5-e98b-4881-81c2-df68406c5789 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.197903 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08962-9e31-4d40-92dd-331607adb0cc None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.219231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.220022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.220331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.220602 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.221777 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.223229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.225221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 95/202] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:27.230380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.233087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.233761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.234043 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.234321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.235029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.236512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.255514 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 108/203] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:27 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:27.256368 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.349406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804e21-aafa-4fb5-aa02-99450930b5ec None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.367330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108074-11c4-47f8-8474-bbc55545eb63 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.384482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.385735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.386023 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.386306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.387612 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.389172 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.391075 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 96/204] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:27.396764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.404665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.405349 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.405634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.405914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.406771 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=8222e8bfebb14ef2870c4a8a462e6c7c) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:27.407089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.408626 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.415120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 109/205] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/role_assignments?user.id=8222e8bfebb14ef2870c4a8a462e6c7c&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:27.521299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6fb8a-e9f7-4d89-903a-1ace572eead7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.560619 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.561299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.561579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.561852 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.636416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.638401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.741535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 97/206] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:02:27.747008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:27.848289 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1899f1f-8bd8-446e-bc9e-568458057940 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:27.885361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:27.886228 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:27.886505 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:27.886778 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:27.888070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:27.889557 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09c929-e495-4971-ba21-54dc74cc3fcb None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:27.896132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 110/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:27.897521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:28.009558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426f42-733b-46ac-a17e-51a18aa5acaa None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:28.044225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:28.044891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:28.045177 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:28.045457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:28.046296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] RBAC: Adding query filter params (role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=8222e8bfebb14ef2870c4a8a462e6c7c) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:28.046611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:28.048057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26385-bc82-4df6-be7b-8836beb5f43e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:28.054260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 98/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:27 2022] GET /identity/v3/role_assignments?user.id=8222e8bfebb14ef2870c4a8a462e6c7c&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:29.779306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25043eb2-bdba-460d-a792-2a979c76aa19 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.780151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25043eb2-bdba-460d-a792-2a979c76aa19 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.780571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25043eb2-bdba-460d-a792-2a979c76aa19 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.782340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 111/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:29.787918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6e96-a62a-41af-8775-001b790f5578 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.788748 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6e96-a62a-41af-8775-001b790f5578 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.789333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6e96-a62a-41af-8775-001b790f5578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.803404 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d193ae7-51af-41d3-b179-86bf7c0086d0 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.804003 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d193ae7-51af-41d3-b179-86bf7c0086d0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.804495 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d193ae7-51af-41d3-b179-86bf7c0086d0 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.806434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 112/210] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:29.809130 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-70cf6e96-a62a-41af-8775-001b790f5578 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:29.810563 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-70cf6e96-a62a-41af-8775-001b790f5578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:29.812156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.812645 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.813112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.829799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:29.831365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:29.881461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 99/211] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:29.883201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712badb-7419-413b-abeb-076a2177eae3 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.883686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712badb-7419-413b-abeb-076a2177eae3 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.884213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712badb-7419-413b-abeb-076a2177eae3 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.886695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 100/212] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:29.891939 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:29.892303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:29.892583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:29.912605 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 113/213] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:29.913782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:29.919835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:29.921680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:29.994993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 101/214] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:30.001029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.016280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf9c9-cc51-4937-b738-d5867e6bbf24 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.060794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.061524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.062045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.062336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.072429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:30.080261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:30.081140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 114/215] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:30.086633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.108567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061195-91ef-4260-abea-eb0580f83489 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.141907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.142703 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.142984 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.143257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.153646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:30.161282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:30.162351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:30.163152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 102/216] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:30.163880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.191104 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb633-7246-4908-98e0-afed092690f9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.231921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.233602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.234315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.234759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.237082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.238712 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.240603 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 115/217] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.241624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.271979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b5090-c502-4917-88d3-b84ff08781d4 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.305199 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.305871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.306150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.306966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.307716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:30.308021 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.309430 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.323251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 103/218] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.323251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.350683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503dd80-1f98-4b57-9231-328515978cd5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.387558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.388248 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.388528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.388811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.389562 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:30.389869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.391241 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.399153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 116/219] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.401048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.424423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fc7b-70a4-4785-84d1-7251b0badddd None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.458163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.458957 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.459322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.459609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.460358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.461960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8ffc-e3ec-4820-8ed9-0e18429063cd None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.482432 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 104/220] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:30 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:30.483716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed12a9-f6ab-4f80-9be7-b88279795fac None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.484007 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed12a9-f6ab-4f80-9be7-b88279795fac None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.484311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed12a9-f6ab-4f80-9be7-b88279795fac None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.485745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 105/221] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:30.486303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed12a9-f6ab-4f80-9be7-b88279795fac None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.500857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14bca-60e5-4514-a643-42561fa813e2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.536711 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.537616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.537880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.538157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] PATH_INFO: `/v3/users/6c52631b50f1497497aec68b14fb1a0e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.553145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] RBAC: Authorizing `identity:get_user(user_id=6c52631b50f1497497aec68b14fb1a0e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.554670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d46d-53cc-4e05-af87-6a80e7653150 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.557256 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 117/222] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/users/6c52631b50f1497497aec68b14fb1a0e => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.558351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.558643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.558912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.576619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:30.577855 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:30.600376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed12a9-f6ab-4f80-9be7-b88279795fac None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.636305 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.637202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.637484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.637763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.639009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.640615 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.642352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 106/223] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.647039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.653150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 118/224] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:30.654031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.759054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f037c2-1855-4b74-a301-2121356b7dcc None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.770775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dee33-3d13-4b2c-951d-d5d70e82201d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.794959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.795674 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.796809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.797263 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.814427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.815937 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.816387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.816798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.818144 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.819750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.821656 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 119/225] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:30.822938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.873313 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:30.874717 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:30.924468 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaac05-fedd-4c3b-a39f-72c82e241eff None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:30.960651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:30.962570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:30.963001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:30.963794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:30.974906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 107/226] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:30.975565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:30.977587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:30.989348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:30.990444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:30.991393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:30.993658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 120/227] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:30.994999 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.080535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3df9e9-7537-4b9e-bc51-bc998b50e775 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.113190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145e97-851f-455c-9017-11604407a2d5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.115224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.116150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.116774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.116774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/8222e8bfebb14ef2870c4a8a462e6c7c/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.119252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, user_id=8222e8bfebb14ef2870c4a8a462e6c7c, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.120734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.136378 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 108/228] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:30 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/8222e8bfebb14ef2870c4a8a462e6c7c/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:31.137202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.155051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.156356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.156837 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.157329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.158762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.160562 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.163714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 121/229] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:30 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:31.170479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.308244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498f13-7ac8-4ec5-b42a-72c595543d4f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.369890 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8961f9-748d-4d89-a730-72889bb38c52 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.389734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.390433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.390714 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.392640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.392640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:31.392640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.393539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.409835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 109/230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:31.412978 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.413108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.413327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.413625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.414457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=6c52631b50f1497497aec68b14fb1a0e) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:31.414772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.416415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.417177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.425456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 122/231] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:31 2022] GET /identity/v3/role_assignments?user.id=6c52631b50f1497497aec68b14fb1a0e&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=b781ae4ae48046a1a9650d001916004e => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:31.531396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd61d-55dc-4158-88f7-602681d44661 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.569343 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.570591 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.571071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.571584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.573708 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.575405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.577447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 110/232] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:31 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:31.583296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.717868 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238fb34-f692-4c79-b196-fb918366036b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.754005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.754877 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.755161 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.755440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.756677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.758158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb3b9-db86-4d92-bc41-5f4ca7ac9b26 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.760496 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 123/233] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:31 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:31.766152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:31.878562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3f02-3a19-4837-ae35-8bf325a0ab30 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:31.913896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:31.914948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:31.915285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:31.915654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/8222e8bfebb14ef2870c4a8a462e6c7c/roles/95cef57c50c74ad2826ae4ae2ce66503` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:31.918086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, user_id=8222e8bfebb14ef2870c4a8a462e6c7c, role_id=95cef57c50c74ad2826ae4ae2ce66503)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:31.919548 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4158-e64b-4230-a455-3960f4d38c6b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:31.936737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 111/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:31 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/8222e8bfebb14ef2870c4a8a462e6c7c/roles/95cef57c50c74ad2826ae4ae2ce66503 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:02:33.232441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711affa-32ca-491b-8ac3-fbee8163e5ed None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.232961 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711affa-32ca-491b-8ac3-fbee8163e5ed None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.233070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711affa-32ca-491b-8ac3-fbee8163e5ed None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.234732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 124/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:33.240235 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6993f-1a2f-4732-8a4a-875258d6f418 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.240706 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6993f-1a2f-4732-8a4a-875258d6f418 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.240886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6993f-1a2f-4732-8a4a-875258d6f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.262960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4de6993f-1a2f-4732-8a4a-875258d6f418 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:33.264195 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4de6993f-1a2f-4732-8a4a-875258d6f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:33.346523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 112/236] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:33.373372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711affa-32ca-491b-8ac3-fbee8163e5ed None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:33.412033 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7626-16f6-418d-a271-232ff2b86076 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.412673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7626-16f6-418d-a271-232ff2b86076 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.413172 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7626-16f6-418d-a271-232ff2b86076 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.414745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 113/237] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:33.423100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.423677 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.424183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.448146 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:33.448146 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:33.551060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711affa-32ca-491b-8ac3-fbee8163e5ed None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:33.578316 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 114/238] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:33.606861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:33.617751 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:33.618574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.619422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.619702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.625208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:33.626700 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:33.631903 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 125/239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:33.637689 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:33.767580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff39a-a297-4a76-ae3c-9c27b823329a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:33.811591 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:33.812338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.812624 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.812899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.836338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:33.849868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:33.850741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:33.851700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 115/240] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:33.856774 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449aa36-2060-4c9d-b8e7-86a653e982d7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:33.857261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:33.899060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:33.900733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:33.901223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:33.903108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:33.904153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:33.908576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:33.954999 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 126/241] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:33 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:34.002809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a70a1-4bdd-4a74-b5ec-7beef6a39fe0 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.062610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.064170 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.064909 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.065598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.067081 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:34.067815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:34.070416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1e28-43bd-42f0-8d49-d6e9ddbbf1d0 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:34.090385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 116/242] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:34.096160 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.232161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d19-4044-4752-829c-9ac1730b23be None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.232161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d19-4044-4752-829c-9ac1730b23be None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.232161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d19-4044-4752-829c-9ac1730b23be None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.233827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 117/243] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:34.239672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.239962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.240276 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.247637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dec277-578b-4b84-a81a-877a3228d445 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.269083 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:34.270588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:34.283878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.284788 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.285148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.285347 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] PATH_INFO: `/v3/users/dbc2c64c968448708a9e64e063ef4f0d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.300418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc2c64c968448708a9e64e063ef4f0d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:34.302020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:34.303793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 127/244] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/users/dbc2c64c968448708a9e64e063ef4f0d => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:34.309512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.346298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 118/245] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:34.375071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.450860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268a7e-682b-4dab-8a0a-76dfedb558b9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.487832 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.488954 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.489439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.489917 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.490620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75140-4050-4abe-9983-979f31abe68b None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.526259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.527016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.527462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.527741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.538047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:34.546581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:34.547470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:34.548311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 119/246] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:34.558094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.574415 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:34.576541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeea17-5280-4156-b9fe-313e03560a0c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:34.699669 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0c13-8e8b-4741-91bd-01e8315b8e1e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.705429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 128/247] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:34.706610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf8d3-3baa-4e2d-aeb6-47f161c7d8d5 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.706975 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf8d3-3baa-4e2d-aeb6-47f161c7d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.707166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf8d3-3baa-4e2d-aeb6-47f161c7d8d5 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.708578 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 129/248] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:34.714570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faf8d3-3baa-4e2d-aeb6-47f161c7d8d5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.756509 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.757201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.757488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.757960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.758716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:34.759020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:34.760676 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca8063-62dc-413f-9089-6fa93424e4cb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:34.769907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 120/249] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:34.777200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.777486 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.777764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.804045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:34.805274 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:34.867263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faf8d3-3baa-4e2d-aeb6-47f161c7d8d5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:34.920811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:34.921686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.921970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.922249 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.923562 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:34.923975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 121/250] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:34.924962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:34.925584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a019-a290-4b3c-9221-5aaa8af9492d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:34.928786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 130/251] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:34.930040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e4b2-6aa4-41c1-87ea-38441f9d887e None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:34.930327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e4b2-6aa4-41c1-87ea-38441f9d887e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:34.930609 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e4b2-6aa4-41c1-87ea-38441f9d887e None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:34.932419 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 131/252] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:34.938043 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e4b2-6aa4-41c1-87ea-38441f9d887e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.044330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce31bb-05f8-4613-a8e3-443a1bd36b7f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.065130 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e4b2-6aa4-41c1-87ea-38441f9d887e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.089098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.090329 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.090896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.091237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.093009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:35.095052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c57631-b93b-4e04-acbc-90896daa6df6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:35.097840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 122/253] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:35.099626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.099918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.100178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.100298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.100846 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.101126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.101408 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.102590 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=dbc2c64c968448708a9e64e063ef4f0d) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:35.102935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:35.104486 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:35.110450 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 132/254] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:34 2022] GET /identity/v3/role_assignments?user.id=dbc2c64c968448708a9e64e063ef4f0d&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:35.111273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.119284 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:35.120690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:35.221940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 123/255] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:35.223081 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.327197 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3e39-26f3-4be0-a054-a23573efb642 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.366431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.367411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.367806 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.368212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.371945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbcef7-b160-44bf-8b2d-c159b1070d57 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.380018 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:35.388871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:35.390041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:35.391016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:35.392650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 133/256] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:35.393666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.415943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.416989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.417291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.419084 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.536291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:35.537768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:35.581226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cfcb-5c16-47d4-ad0b-73f6e10bbce7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.642043 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.642859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.643144 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.643452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.653798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:35.662082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:35.662959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:35.664185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 134/257] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:35.669559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.735674 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 124/258] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:35.736555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.778554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aafc5-9deb-47e3-91e0-094c39ba2912 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.814008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.814692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.814977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.815257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.816014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:35.816353 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:35.817731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:35.826569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 135/259] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:35.827411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:35.936940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567338-09aa-4728-ac9b-7d74f27f41ed None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.967762 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0ecb-2002-4d4c-9083-ecbb76c43c52 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:35.978305 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:35.979410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:35.979692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:35.979969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:35.981258 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:35.982725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:35.987822 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 136/260] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:35.994460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.043799 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.044523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.044817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.045093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.045853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:36.046161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.050699 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.071387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 125/261] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:36.072526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.189937 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccfc2-0c44-4a32-9c75-cc7ba87c7ac5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.238514 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702a78-2703-43e4-b35e-3063ad08d5a1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.254901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.256051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.256550 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.257046 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] PATH_INFO: `/v3/users/6c52631b50f1497497aec68b14fb1a0e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.260820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] RBAC: Authorizing `identity:get_user(user_id=6c52631b50f1497497aec68b14fb1a0e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.262486 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.264351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 137/262] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:35 2022] GET /identity/v3/users/6c52631b50f1497497aec68b14fb1a0e => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:36.267790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.279664 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.280365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.280653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.280932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.281774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=8222e8bfebb14ef2870c4a8a462e6c7c) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:36.282086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.283538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.294293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 126/263] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:36 2022] GET /identity/v3/role_assignments?user.id=8222e8bfebb14ef2870c4a8a462e6c7c&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:36.295095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.548493 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f614576-7c96-4758-b79b-12cb7f8d3c00 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.580602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d984-98c0-4498-b183-69386f213405 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.622239 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.623157 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.623394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.623673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.628387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.628882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.629696 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.630170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.630358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.630814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] PATH_INFO: `/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.632222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] RBAC: Authorizing `identity:get_user(user_id=8222e8bfebb14ef2870c4a8a462e6c7c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.632459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 127/264] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:36 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:36.634680 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.636593 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 138/265] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:36 2022] GET /identity/v3/users/8222e8bfebb14ef2870c4a8a462e6c7c => generated 283 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:36.641939 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.642960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:36.748260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b735dd-a7bd-4888-a8ef-52ed7a20a5dc None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.782584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.783856 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.784365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.784834 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/6c52631b50f1497497aec68b14fb1a0e/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.787047 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, user_id=6c52631b50f1497497aec68b14fb1a0e, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:36.788806 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:36.812336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 139/266] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:36 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/6c52631b50f1497497aec68b14fb1a0e/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:36.846201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f8c5-2457-455f-8a88-c1faf9de1b74 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:36.897566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:36.898243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:36.898585 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:36.898865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:36.998701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:37.000734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21fe38-d7cb-45f1-90bd-96731b52d9bf None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:37.105943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 128/267] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:37.111294 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.271175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980cff9-badb-4b21-8361-5fcaedd7da7c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:37.283831 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691af5-6b21-4489-9fe2-b017b2a2359c None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.284150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691af5-6b21-4489-9fe2-b017b2a2359c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.284428 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691af5-6b21-4489-9fe2-b017b2a2359c None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.285814 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 129/268] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:37.291122 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d394-8312-42d4-b2e6-cfa4ed4cec94 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.291534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d394-8312-42d4-b2e6-cfa4ed4cec94 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.291819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d394-8312-42d4-b2e6-cfa4ed4cec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.311621 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:37.312838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.313283 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.313703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.315058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:37.316690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:37.318679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 140/269] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:37 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:37.323496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2934d394-8312-42d4-b2e6-cfa4ed4cec94 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:37.323496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2934d394-8312-42d4-b2e6-cfa4ed4cec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:37.324677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.452936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299a8-44dc-4e1e-ac61-b25103b1edf8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:37.454102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 130/270] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:37.456598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e481-e79a-49c4-910e-201f900b879c None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.457111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e481-e79a-49c4-910e-201f900b879c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.457582 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e481-e79a-49c4-910e-201f900b879c None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.459048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 131/271] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:37.479542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.480196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.480699 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.502236 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:37.503739 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:37.505934 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:37.506676 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.507079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.507424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.508443 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] RBAC: Adding query filter params (role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=8222e8bfebb14ef2870c4a8a462e6c7c) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:37.508827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:37.510435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:37.516713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 141/272] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:37 2022] GET /identity/v3/role_assignments?user.id=8222e8bfebb14ef2870c4a8a462e6c7c&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:37.517788 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.620735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 132/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:37.674222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acb4aa-90d6-4ac7-a4a0-9e299de6a6a2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:37.679002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.745727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:37.746450 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.746733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.747012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.748270 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:37.750209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:37.752224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 142/274] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:37.757668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.830373 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6501471-6c6c-4381-ae3b-80b017d5db5d None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:37.879517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:37.880571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.880960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.881335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.891155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93862-3f72-4bd5-8842-1a374156263a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:37.893123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:37.902661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:37.903671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:37.904687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 133/275] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:37.914730 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:37.952726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:37.953667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:37.954051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:37.954594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:37.955773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:37.957663 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:37.989448 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 143/276] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:02:37 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:02:38.061542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787538c4-2eca-4d1b-84e9-9554fefa7502 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.100279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.101270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.101703 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.102127 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.103241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:38.103730 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:38.105387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5be17-35da-40df-aa74-8d59da701b84 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:38.115063 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 134/277] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:38.121226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.123064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d113749-d456-41bd-8813-82cd340f51db None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.123363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d113749-d456-41bd-8813-82cd340f51db None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.123644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d113749-d456-41bd-8813-82cd340f51db None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.126982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 135/278] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:38.139391 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.139725 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.139958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.162350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:38.163929 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:38.241838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 136/279] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:38.250970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7276-7c08-4130-a4de-0f2e3e01ce35 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.266469 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.286807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.287917 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.288364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.288774 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] PATH_INFO: `/v3/users/a279e1e3d870431eb54e06b3bd9fc32b` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.303261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] RBAC: Authorizing `identity:get_user(user_id=a279e1e3d870431eb54e06b3bd9fc32b)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:38.304969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:38.307253 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 144/280] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/users/a279e1e3d870431eb54e06b3bd9fc32b => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:38.313848 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.378255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5797c-15eb-4363-883e-5e003eb3a8d9 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.417277 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a5a-280a-416a-8dbc-4a569da64a42 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.419567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.420622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.420887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.421526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.432579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:38.441618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:38.442513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:38.443289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 137/281] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:38.454282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.456644 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.457304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.457582 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.457851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.458685 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, user.id=a279e1e3d870431eb54e06b3bd9fc32b, scope.system=all) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:38.458992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:38.460458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:38.472585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 145/282] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/role_assignments?user.id=a279e1e3d870431eb54e06b3bd9fc32b&scope.system=all&role.id=b781ae4ae48046a1a9650d001916004e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:38.571469 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89216c5a-4c82-4078-ac31-b97dcfec78d9 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.609433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.610129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.610416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.610693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.611451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:38.611754 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:38.613198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:38.624646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 138/283] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:38.630179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.775452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb09c-b14f-4af8-bcf1-81d4de236833 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.823163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.823967 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:38.824274 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:38.824549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] PATH_INFO: `/v3/users/dbc2c64c968448708a9e64e063ef4f0d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:38.825776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] RBAC: Authorizing `identity:get_user(user_id=dbc2c64c968448708a9e64e063ef4f0d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:38.827219 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:38.829061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 146/284] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/users/dbc2c64c968448708a9e64e063ef4f0d => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:38.835344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:38.964038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5304-61ca-4e70-a449-ffec0aba65ac None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:38.998978 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:38.999855 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:39.000147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:39.000427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:39.001673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:39.003124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73733-b233-461e-b0f5-7cd863867bc2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:39.005199 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 139/285] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:38 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:39.010990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:39.166249 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4ac9-2287-4e41-ad4d-a28c0cf3c0cf None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:39.213491 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:39.214383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:39.214661 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:39.214936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/dbc2c64c968448708a9e64e063ef4f0d/roles/fa7a0d3b4bf34a32951076f482e9d33a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:39.216927 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, user_id=dbc2c64c968448708a9e64e063ef4f0d, role_id=fa7a0d3b4bf34a32951076f482e9d33a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:39.218358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6174d-d647-4d99-8285-440dbbd5642d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:39.244753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 147/286] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:02:39 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/users/dbc2c64c968448708a9e64e063ef4f0d/roles/fa7a0d3b4bf34a32951076f482e9d33a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:39.613691 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb239f-ba63-42a0-88eb-747a23b0c8eb None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:39.614055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb239f-ba63-42a0-88eb-747a23b0c8eb None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:39.614308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb239f-ba63-42a0-88eb-747a23b0c8eb None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:39.615919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 140/287] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:39.623515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:39.623803 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:39.624081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:39.643080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:39.644330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:39.735652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 148/288] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:39.776540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb239f-ba63-42a0-88eb-747a23b0c8eb None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:39.886621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb239f-ba63-42a0-88eb-747a23b0c8eb None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:39.920750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:39.921545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:39.921825 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:39.922098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:39.932417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:39.940783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:39.941718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:39.942535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 141/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:39.950807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:40.074707 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613fb7c-b313-41d6-bca6-1802078d5dea None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:40.110542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:40.111583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.112065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.112570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.113703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:40.114211 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:40.115873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:40.125723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 149/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:40.131481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:40.251482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384e8e-d9a3-41da-9889-2854a213b5b9 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:40.287915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:40.289359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.289863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.290400 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] PATH_INFO: `/v3/users/6c52631b50f1497497aec68b14fb1a0e` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.292088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] RBAC: Authorizing `identity:get_user(user_id=6c52631b50f1497497aec68b14fb1a0e)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:40.293827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:40.295979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 142/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:40 2022] GET /identity/v3/users/6c52631b50f1497497aec68b14fb1a0e => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:40.301706 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:40.407994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4e50-2716-4fc5-9579-2e17ea2a7cca None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:40.453913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:40.454944 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.455430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.455911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.527009 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:40.528954 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:40.631307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 150/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:40.637740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:40.741428 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66692-2696-4751-9f6c-c7f86e56cfdc None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:40.780781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:40.782453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.782963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.783446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.784880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:40.786531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e6d2d-2968-48b2-b1a4-546ef1187280 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:40.788899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 143/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:40 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:40.795143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:40.898435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917fd3-d351-4946-ac1f-3112df98654c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:40.939807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:40.940496 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.940780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.941059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.941899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=6c52631b50f1497497aec68b14fb1a0e) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:40.942211 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:40.943651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4909-37e5-4f44-b210-9af4cd7a55d0 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:40.950726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 151/294] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:40 2022] GET /identity/v3/role_assignments?user.id=6c52631b50f1497497aec68b14fb1a0e&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=b781ae4ae48046a1a9650d001916004e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:40.951262 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac544c-2a14-4421-a88e-7e3b207d8247 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.951804 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac544c-2a14-4421-a88e-7e3b207d8247 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.952358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac544c-2a14-4421-a88e-7e3b207d8247 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.953926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 144/295] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:40.970777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6d31-5498-44e0-9093-0ad7d9bc1fc7 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:40.971328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6d31-5498-44e0-9093-0ad7d9bc1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:40.971328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6d31-5498-44e0-9093-0ad7d9bc1fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:40.995688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e64b6d31-5498-44e0-9093-0ad7d9bc1fc7 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:40.996854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e64b6d31-5498-44e0-9093-0ad7d9bc1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:41.103359 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 152/296] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:41.144611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac544c-2a14-4421-a88e-7e3b207d8247 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.286403 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c3fc-5d7c-4fb4-9e6d-48923cc7e011 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.286712 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c3fc-5d7c-4fb4-9e6d-48923cc7e011 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.286880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c3fc-5d7c-4fb4-9e6d-48923cc7e011 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.289474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 153/297] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:41.292555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac544c-2a14-4421-a88e-7e3b207d8247 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.296057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.296387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.296670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.317259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:41.318438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:41.334840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.336534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.337070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.338140 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.340828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:41.343100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:41.345813 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 145/298] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:41.351898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.414113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 154/299] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:41.439552 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.495674 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6920ad-cf0e-4211-9988-1713b92ed45d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.530664 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.531333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.531621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.531894 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] PATH_INFO: `/v3/groups` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.532622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:41.534078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a09bb5-6340-403c-97e1-20e5dff5c1e6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:41.545855 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c3dc-f908-4ac9-834d-0661f51c4b42 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.556154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 146/300] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 12 07:02:41 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:02:41.556154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c45b1-56c6-43de-be02-aefaefbda9ef None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.556154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c45b1-56c6-43de-be02-aefaefbda9ef None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.556154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c45b1-56c6-43de-be02-aefaefbda9ef None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.556154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 147/301] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:41.563724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.564020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.564322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.589585 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:41.591327 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:41.592438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.593330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.593682 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.594028 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.614290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:41.625783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:41.626887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:41.627671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 155/302] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:41.632973 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.680516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 148/303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:41.699186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.746749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3953-2c75-40f9-b7d7-3d59d5b806a6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.782995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.783681 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.783946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.784283 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.785032 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:41.785339 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:41.786717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:41.797222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 156/304] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:41.803601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.803756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b280a70-fa4c-4bff-91bd-b4ecd69595f7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.839577 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.840414 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.840691 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.841704 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.859778 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:41.871129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:41.872291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:41.873569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 149/305] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:41.877999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.917242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b313478-cd25-4052-9f6e-d20481221b01 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:41.952442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:41.953396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:41.953682 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:41.953957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] PATH_INFO: `/v3/users/4ae0be12945b4d09a0cc1b2e40517957` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:41.968520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae0be12945b4d09a0cc1b2e40517957)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:41.970000 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:41.972165 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 157/306] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/users/4ae0be12945b4d09a0cc1b2e40517957 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:41.977554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:41.985237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307733-9386-4040-8f92-d77f3042a1da None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.029901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.030607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.031164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.031453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.032269 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:42.032585 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:42.033987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:42.045847 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 150/307] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:42.051738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:42.086242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37a0f-2bfd-4c14-af8f-10434d7f7da4 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.122464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.123522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.124003 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.124497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.125667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, user.id=4ae0be12945b4d09a0cc1b2e40517957, scope.system=all) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:42.126180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:42.127866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:42.140283 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 158/308] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 12 07:02:41 2022] GET /identity/v3/role_assignments?user.id=4ae0be12945b4d09a0cc1b2e40517957&scope.system=all&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:42.156604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f07d0-efa4-499f-b475-bf70f62c80c2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.196863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.197815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.198104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.198385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] PATH_INFO: `/v3/users/a279e1e3d870431eb54e06b3bd9fc32b` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.199885 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] RBAC: Authorizing `identity:get_user(user_id=a279e1e3d870431eb54e06b3bd9fc32b)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:42.201586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f07aa-4480-4f4d-ac67-d90b7527f9a7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:42.203462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 151/309] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:42 2022] GET /identity/v3/users/a279e1e3d870431eb54e06b3bd9fc32b => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:42.209495 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:42.327311 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048a87-573e-49b8-8260-dfa793fe2708 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.363092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.363960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.364264 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.364543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] PATH_INFO: `/v3/system/users/a279e1e3d870431eb54e06b3bd9fc32b/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.366031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a279e1e3d870431eb54e06b3bd9fc32b, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:42.367417 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c908-99ba-4b03-b0e9-ae312bfae4e5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:42.382027 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 159/310] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 12 07:02:42 2022] PUT /identity/v3/system/users/a279e1e3d870431eb54e06b3bd9fc32b/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:42.398407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddebb-855e-4f24-9481-7111aab83b49 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.398687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddebb-855e-4f24-9481-7111aab83b49 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.398970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddebb-855e-4f24-9481-7111aab83b49 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.401436 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 152/311] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:42.408812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.409343 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.409933 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.432316 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:42.433771 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:42.516298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 160/312] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:42.534167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ddebb-855e-4f24-9481-7111aab83b49 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:42.648105 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ddebb-855e-4f24-9481-7111aab83b49 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.682124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.682927 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.683204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.683473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.695348 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:42.703633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:42.704573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:42.705356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:42.709716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 153/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:42.711063 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:42.808617 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971b3e7-807b-4661-b6df-7afbdfc10c8d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:42.841520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:42.842183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:42.842508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:42.842787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:42.843524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:42.843826 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:42.845242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:42.858432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 161/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:42.859830 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:42.967557 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ab266-8935-4eab-a794-64766bc6f5b6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:43.001962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:43.002839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:43.003183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:43.003464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] PATH_INFO: `/v3/users/dbc2c64c968448708a9e64e063ef4f0d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:43.004686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc2c64c968448708a9e64e063ef4f0d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:43.006173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:43.012261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 154/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:42 2022] GET /identity/v3/users/dbc2c64c968448708a9e64e063ef4f0d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:43.014436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:43.121255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943772f-ef08-48fb-9f2a-017715002851 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:43.155759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:43.156839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:43.157345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:43.157824 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:43.227171 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:43.229594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:43.333235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 162/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:43.340164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:43.440656 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ff99-6e0c-4c15-afda-e7e1c447d7b3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:43.474541 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:43.475408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:43.475687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:43.475964 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:43.477243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:43.479309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaf1d8-7977-4f3b-9437-bc39dede822c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:43.485838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 155/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:43 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:43.489201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:43.590080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeaa3d-fd5b-4b47-9e44-13c94dc90dc8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:43.627485 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:43.628166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:43.628459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:43.628746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:43.629647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c, user.id=dbc2c64c968448708a9e64e063ef4f0d) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:43.629965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:43.631454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bd68e-899c-4675-b80e-0d84b9192d47 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:43.637706 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 163/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:02:43 2022] GET /identity/v3/role_assignments?user.id=dbc2c64c968448708a9e64e063ef4f0d&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:44.119963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab86ae3-838d-41ec-8d81-8200c037f5b5 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.120515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab86ae3-838d-41ec-8d81-8200c037f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.120590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab86ae3-838d-41ec-8d81-8200c037f5b5 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.122052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 156/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:44.127145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.127552 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.127718 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.144575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:44.145742 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:44.209407 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 164/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:44.233973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab86ae3-838d-41ec-8d81-8200c037f5b5 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:44.333431 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab86ae3-838d-41ec-8d81-8200c037f5b5 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:44.370326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:44.371039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.371318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.371589 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.372755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:44.374207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9b94-a43f-4715-9612-3072f0f4e29c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:44.375958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 157/321] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:44.381454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:44.486100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bce3b8-8653-41e7-acfa-c88c59997dd0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:44.518866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:44.519526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.519803 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.520076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] PATH_INFO: `/v3/groups` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.520801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:44.522263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:44.526277 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0ce4-b016-4da7-8fc0-ec6b78326bfd None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.526560 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0ce4-b016-4da7-8fc0-ec6b78326bfd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.526835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0ce4-b016-4da7-8fc0-ec6b78326bfd None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.528229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 158/322] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:44.533984 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3711d4-dce6-4d81-86f0-9d7414efc19f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.534254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3711d4-dce6-4d81-86f0-9d7414efc19f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.534529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3711d4-dce6-4d81-86f0-9d7414efc19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.548152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 165/323] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 12 07:02:44 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:02:44.552750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ba3711d4-dce6-4d81-86f0-9d7414efc19f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:44.553964 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ba3711d4-dce6-4d81-86f0-9d7414efc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:44.637180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 159/324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:44.660962 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:44.767979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e847f-135c-453d-ace7-7a6afa1523ee None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:44.801282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c644-a088-4f97-8731-9055d1d850e0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.802743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c644-a088-4f97-8731-9055d1d850e0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.803224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c644-a088-4f97-8731-9055d1d850e0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.804180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:44.804908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 160/325] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:44.805021 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.805232 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.805508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.812072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:44.812392 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:44.812675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:44.817846 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:44.827887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:44.828888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:44.829664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 166/326] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:44.833183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:44.834408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:44.836332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:44.929282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 161/327] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:44.953779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:44.959852 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6ced-4cfc-43b6-b01c-e2b63c2df080 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.004016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.004725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.005006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.005285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.006038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:45.006343 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.007746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.020541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 167/328] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:45.023794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:45.074188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc5c18-78b8-45bd-9fcc-fd6794d9df31 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.112502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.113616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.114039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.114480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.126070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:45.135137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:45.136251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:45.137037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:45.137961 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 162/329] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:45.143535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:45.150674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c6c9-57a8-4123-9756-505d7fce6600 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.188521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.190023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.190510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.190991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] PATH_INFO: `/v3/users/4ae0be12945b4d09a0cc1b2e40517957` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.192436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae0be12945b4d09a0cc1b2e40517957)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.194092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.197140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 168/330] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:45 2022] GET /identity/v3/users/4ae0be12945b4d09a0cc1b2e40517957 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:45.202458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:45.257950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3605-f1f9-4c2f-a5de-3020f094a7a8 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.302124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.302806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.303089 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.303366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.304445 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:45.304750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.307364 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.318322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 163/331] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:45.326185 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:45.328770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf6eb-f028-43bb-993c-23356bd75a13 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.365812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.366973 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.367455 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.367873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] PATH_INFO: `/v3/system/users/4ae0be12945b4d09a0cc1b2e40517957/roles/fa7a0d3b4bf34a32951076f482e9d33a` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.369855 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4ae0be12945b4d09a0cc1b2e40517957, role_id=fa7a0d3b4bf34a32951076f482e9d33a)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.371458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.383398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 169/332] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 12 07:02:45 2022] PUT /identity/v3/system/users/4ae0be12945b4d09a0cc1b2e40517957/roles/fa7a0d3b4bf34a32951076f482e9d33a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:02:45.478041 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0afb39-23e3-4bac-8134-b5549ddf3e7d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.527586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.528527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.528809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.529083 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] PATH_INFO: `/v3/users/a279e1e3d870431eb54e06b3bd9fc32b` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.530444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] RBAC: Authorizing `identity:get_user(user_id=a279e1e3d870431eb54e06b3bd9fc32b)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.531918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd70ff-f74d-4ab5-b998-cfe32d9c161a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.533826 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 164/333] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:45 2022] GET /identity/v3/users/a279e1e3d870431eb54e06b3bd9fc32b => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:45.541929 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:45.671941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc14e-cbb8-4e86-9fad-32e1bcb276aa None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:45.710530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:45.711572 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:45.712141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:45.712626 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:45.713757 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] RBAC: Adding query filter params (role.id=b781ae4ae48046a1a9650d001916004e, user.id=a279e1e3d870431eb54e06b3bd9fc32b, scope.system=all) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:45.714291 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:45.715944 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670a1e7-60b0-4216-bbc5-a59c84495790 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:45.729234 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 170/334] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 12 07:02:45 2022] GET /identity/v3/role_assignments?user.id=a279e1e3d870431eb54e06b3bd9fc32b&scope.system=all&role.id=b781ae4ae48046a1a9650d001916004e => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:47.482705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5030-2b8e-4420-b19c-968b47ce6042 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:47.483268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5030-2b8e-4420-b19c-968b47ce6042 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:47.483268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5030-2b8e-4420-b19c-968b47ce6042 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:47.485011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 165/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:47.494174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:47.495292 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:47.495795 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:47.525305 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:47.526866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:47.610438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 171/336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:47.651828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc5030-2b8e-4420-b19c-968b47ce6042 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:47.773606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc5030-2b8e-4420-b19c-968b47ce6042 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:47.820868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:47.821734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:47.822011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:47.822283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:47.834372 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:47.842532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:47.843459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:47.844350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 166/337] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:47.849765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:47.960065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca39373-de98-454b-9606-2cf7156e4d84 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.002573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.003250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.003527 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.003799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.004572 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:48.004877 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.006248 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9798-79b9-452d-8d48-441816d26103 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.014896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 172/338] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:48.020396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.034984 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443d6b-d8f3-4db5-bd78-097e2c8976dd None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.035267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443d6b-d8f3-4db5-bd78-097e2c8976dd None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.035464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443d6b-d8f3-4db5-bd78-097e2c8976dd None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.036851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 173/339] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:48.042121 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.042397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.042680 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.059714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:48.060930 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:48.129457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 174/340] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:48.155398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.188424 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d4ce-a4c1-4125-b08b-87dc7a6252b0 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.237486 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.238513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.239015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.239510 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.257795 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd93a7-e92c-48e2-ac5d-db59c95741b5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.292785 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.293505 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.293777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.294054 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.306966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:48.314619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:48.315519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:48.316758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 175/341] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:48.322268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.327756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.329583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.425389 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c40e9-7faf-454b-aa3f-831a6fe5f7fa None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.442037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 167/342] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:48.448827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.518216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.518904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.519191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.519473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.520268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:48.520604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.521967 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.534285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 176/343] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:48.539696 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.557215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8827-c17c-4941-8c45-fcbaffdc1115 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.595203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.596085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.596409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.596686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.597907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.599604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.601506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 168/344] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:48.607586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.675340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c489a-cc1a-4ae8-a2d3-1f1edbbf55ed None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.709705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18fa1-277c-431c-bc17-f5b7e7f2eaf4 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.728871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.729549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.729841 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.730124 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.747220 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.748163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.748460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.748735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.755300 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.756911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f0be-a1cd-4e84-ad54-c8872361f176 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.761818 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 169/345] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:48.763203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ce6-4549-4516-af34-280286007d28 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.763503 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ce6-4549-4516-af34-280286007d28 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.763782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ce6-4549-4516-af34-280286007d28 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.765216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 170/346] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:48.768293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8ce6-4549-4516-af34-280286007d28 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.825958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.827350 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.883881 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8ce6-4549-4516-af34-280286007d28 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:48.920626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:48.921299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.921583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.921861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.922696 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=cc56a2c8a6074cb48204eace1d91657d) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:48.923005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:48.924580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab5584-d34e-4cd0-b000-3e6d620ea790 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:48.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 171/348] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:48.933433 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 177/348] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:02:48.934466 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:48.934759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:48.935036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:48.939845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:48.958214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:48.959454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:49.044403 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 172/349] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:49.083484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.111577 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3953f-9a30-4d53-a8dc-e210f1feb06c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.173041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.173919 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.174197 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.174473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.177735 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:49.179386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:49.182012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 178/350] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:48 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:49.187686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.278879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3703098-bd93-4c9f-a1cd-5fb9a55684b0 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.330727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.331545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.331825 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.332103 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.355467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:49.366631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:49.369700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:49.371558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 173/351] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:49.376213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34efab-d6f8-4ee2-8e72-23838f6954a8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.381153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.453399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.454642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.454921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.455194 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.460968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:49.463306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b1075-bc19-44d3-9635-4c9a70eae3d5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:49.465067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 179/352] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:49.469146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075362a9-0751-44ea-a46c-002961ab4dd8 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.469508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075362a9-0751-44ea-a46c-002961ab4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.469794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075362a9-0751-44ea-a46c-002961ab4dd8 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.471384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 180/353] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:49.472195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075362a9-0751-44ea-a46c-002961ab4dd8 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.514661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f8921-7191-4fbe-b220-1302b1ac0d65 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.551527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.552785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.553147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.553429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.554251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:49.554600 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:49.556670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34a16-75db-4845-811a-43b4fdab3ba5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:49.565798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 174/354] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:49.567193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.567482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.567758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.585678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:49.587456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:49.593480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075362a9-0751-44ea-a46c-002961ab4dd8 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.637908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.638581 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.638860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.639133 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.639979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=cc56a2c8a6074cb48204eace1d91657d) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:49.640324 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:49.641788 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:49.647622 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 181/355] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=b781ae4ae48046a1a9650d001916004e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:49.648598 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.676179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 175/356] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:49.693283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.798221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccd7d-bd43-4250-8e23-52ca62b2ffa4 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.803854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd44c2-701a-4fc2-a369-d4e7edd9f997 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:49.842531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.843363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.843640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.843914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.849033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:49.849715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:49.849995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:49.850270 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:49.881311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:49.889565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:49.890511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:49.891304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 176/357] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:49.896879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:49.936798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:49.938417 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.049815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 182/358] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:50.056067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.135660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5333-d662-4678-baa8-3445d3ed8908 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.201635 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.202683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.203169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.203642 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.204635 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:50.205161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.206767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3f94-44bc-4dee-bde2-fb192c86b67e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.220429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 177/359] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:50.226114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18560fc-9977-4692-b9c4-5e95cdac20ff None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.226815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18560fc-9977-4692-b9c4-5e95cdac20ff None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.229449 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18560fc-9977-4692-b9c4-5e95cdac20ff None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.231744 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 178/360] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:50.233323 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18560fc-9977-4692-b9c4-5e95cdac20ff None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.235882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1356-da01-42f7-a2c1-dc750631101f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.293987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.295686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.295977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.296297 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.297526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.298986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e35b8-43f6-4fcd-9959-33bd316fe9c4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.301615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 183/361] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:50.302809 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fa639-8453-4904-8f79-c735453f2db7 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.303098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fa639-8453-4904-8f79-c735453f2db7 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.303396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fa639-8453-4904-8f79-c735453f2db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.326453 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-c84fa639-8453-4904-8f79-c735453f2db7 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:50.327762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-c84fa639-8453-4904-8f79-c735453f2db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:50.388756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18560fc-9977-4692-b9c4-5e95cdac20ff None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.417968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 184/362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:50.419422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65c08-6630-41e7-97d2-ed59ff2c988f None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.419720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65c08-6630-41e7-97d2-ed59ff2c988f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.419999 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65c08-6630-41e7-97d2-ed59ff2c988f None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.421720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 185/363] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:50.422450 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65c08-6630-41e7-97d2-ed59ff2c988f None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.469499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.471491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.471775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.473518 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] PATH_INFO: `/v3/users/4ae0be12945b4d09a0cc1b2e40517957` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.476653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae0be12945b4d09a0cc1b2e40517957)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.479156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bea156-31c7-47e4-9d1a-9fa73ad7abc6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.480930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 179/364] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/users/4ae0be12945b4d09a0cc1b2e40517957 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:50.482194 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.482479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.482754 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.505910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:50.507094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:50.558935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65c08-6630-41e7-97d2-ed59ff2c988f None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.597719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 180/365] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:50.600056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.604262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.605365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.605783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.606162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.607581 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.609307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.611170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 186/366] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:50.612084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.724022 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7833c-8407-43fe-97fa-06bf7f7b97b0 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.726737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a3fcb-b1c2-462f-900d-4a31e67c79c1 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.766332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.767342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.767875 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.768430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.769472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] RBAC: Adding query filter params (role.id=fa7a0d3b4bf34a32951076f482e9d33a, user.id=4ae0be12945b4d09a0cc1b2e40517957, scope.system=all) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:50.769974 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.771639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.771901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.772487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.772845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.773127 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.785584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 187/367] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/role_assignments?user.id=4ae0be12945b4d09a0cc1b2e40517957&scope.system=all&role.id=fa7a0d3b4bf34a32951076f482e9d33a => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:50.786417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:50.786969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:50.797098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:50.798079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:50.798901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 181/368] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:50.799556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.923483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031da0b-0e06-4550-9d85-794a3a91e31a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.928957 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba19c0-f48f-4743-a84c-e24fc0422c93 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.964863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.965940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.966464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.966934 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.967971 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:50.968511 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.970157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.979462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.980175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 188/369] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=b781ae4ae48046a1a9650d001916004e => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:50.980536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.980828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.981106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.981987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.998751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:51.007345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:51.008480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:51.009871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:51.017107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 182/370] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:51.022808 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.098779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c952f-a8cc-4fef-a872-2247b1035e19 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.139677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.140822 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.141315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.141824 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.142820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:51.143334 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.144970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.155191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 189/371] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:51.161266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.200753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b09c0-d771-438c-8266-922a5afe1ec1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.281457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.282073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.282366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.282665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.283409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:51.284047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.287159 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d215-2871-4fd8-a05b-44ae9005a999 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.289322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.303999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 183/372] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:51.309697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.342439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.343106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.343386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.343659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.418126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.419599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.442466 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51839-14f5-45a1-9e0d-b6355b5d708c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.492078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.492078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.492078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.492078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.535446 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 190/373] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:02:51.540878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.575473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.576977 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.667010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b648a8-6a19-4b2e-b053-1de1cec999ee None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.682877 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 184/374] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:02:51.701609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.708145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.709013 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.709295 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.709574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] PATH_INFO: `/v3/projects/bb9a0833837c452ba8e446c72d6e4378` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.711226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb9a0833837c452ba8e446c72d6e4378)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.712778 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.714866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 191/375] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/projects/bb9a0833837c452ba8e446c72d6e4378 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:51.725037 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.827208 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5da35-64f1-4e9a-9391-4d81f3ef7da7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.876688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6c16-64e8-4248-96d2-58c78dd5e3f0 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:51.889722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.890613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.890896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.891237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.892539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.894011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.895995 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 185/376] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:51.902504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:51.927360 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:51.928639 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:51.929177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:51.929665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] PATH_INFO: `/v3/groups/ae34680ffe8c46e8aa55710f8ed30285` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:51.937820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] RBAC: Authorizing `identity:get_group(group_id=ae34680ffe8c46e8aa55710f8ed30285)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:51.939800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:51.942153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 192/377] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/groups/ae34680ffe8c46e8aa55710f8ed30285 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:51.949185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:52.106460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba40d-7444-4e78-b033-5978c4d73413 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:52.107393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9aa37-7bf4-4a70-b723-58550d223594 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:52.156861 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:52.157531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:52.157813 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:52.158091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:52.158956 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] RBAC: Adding query filter params (group.id=ae34680ffe8c46e8aa55710f8ed30285, role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=bb9a0833837c452ba8e446c72d6e4378) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:52.159268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:52.162188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:52.176188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 193/378] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/role_assignments?group.id=ae34680ffe8c46e8aa55710f8ed30285&scope.project.id=bb9a0833837c452ba8e446c72d6e4378&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:52.215873 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:52.216802 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:52.217080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:52.217350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:52.218566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:52.220042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3a42-95ad-4dd7-97a3-d006d00886c0 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:52.222110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 186/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:51 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:52.228583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:52.365127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f761-6a69-4e07-ab2e-a562e43b951f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:52.406758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:52.407438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:52.407720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:52.407994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:52.408867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:52.409237 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:52.410637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38855-7c73-41bc-8a62-daf8cf3f9b0a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:52.420979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 194/380] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:52 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:53.131206 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2bb3-5203-45d9-89be-13cbb7f6e38b None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.131757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2bb3-5203-45d9-89be-13cbb7f6e38b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.131757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2bb3-5203-45d9-89be-13cbb7f6e38b None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.133150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 187/381] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:53.139516 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.139947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.140187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.161148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:53.162328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:53.173570 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eb742-ab07-408d-8f81-67637aa130c6 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.173868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eb742-ab07-408d-8f81-67637aa130c6 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.174147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eb742-ab07-408d-8f81-67637aa130c6 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.175804 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 188/382] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:53.181331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.181627 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.181912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.213771 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:53.214971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:53.267954 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 195/383] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:53.295808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.334184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 189/384] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:53.374459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.412574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddd5ed-0249-499f-ae26-d5b34f05b7f4 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:53.458308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:53.459115 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.459393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.459665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.478504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:53.497843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:53.498802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:53.499671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 196/385] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:53.505831 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.567648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa1dcb-0755-4871-9544-acb6ae4b85e7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:53.636341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aced92-dded-403a-845d-0fcdfdfad4ee None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:53.655893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:53.656745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.657026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.657296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.679020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:53.679625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.679909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.680307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.681981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:53.682296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:53.683720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:53.690047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:53.698467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 197/386] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:53.699073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:53.699910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:53.700727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:53.701326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.710198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 190/387] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:53.716404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.815730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c5ba-b414-4ff9-bc3a-e762533f46a5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:53.862106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:53.862976 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.863263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.863544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.866752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:53.868320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:53.876585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 198/388] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:53.893607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:53.913737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975f9f-4e61-4a65-8bbb-4d6eafc25c31 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:53.994302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:53.994930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:53.995216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:53.995494 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:53.996289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:53.996601 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:53.997997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.011890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 191/389] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:54.017421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.041651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e4a07-d9c5-4b9e-a9fd-049066afc4bd None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.077314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.078184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.078462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.078737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.080480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.081423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.083419 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 199/390] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:53 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:54.089932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.190611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393de5-fe71-4a7b-883e-2ceee9397a7b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.202836 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeecc99-1881-4ef9-a624-08598fdcc2d7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.238087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.238980 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.239263 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.239538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.241038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.242265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca229-c26f-4740-a503-7e932bd03ac5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.245047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 192/391] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:54 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:54.246214 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb21a-ed93-4368-8ee6-c6dd5d80518e None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.246501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb21a-ed93-4368-8ee6-c6dd5d80518e None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.246832 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb21a-ed93-4368-8ee6-c6dd5d80518e None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.252321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 193/392] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:54.254645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.254935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.255216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.257622 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.258670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.259117 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.259552 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.262894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, group_id=ae71a3b89b5242d4891936e8fefaf7d2, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.264560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.276770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:54.277959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:54.280556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 200/393] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 12 07:02:54 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:54.282524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.358034 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 194/394] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:54.385796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.404228 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcf9c-5da2-43e8-93ef-49c960e97b9c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.456674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.457798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.458232 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.458653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.460053 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.462236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.468527 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 201/395] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:54 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:54.473423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.523704 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa762d1-1fe2-4b0e-9776-182496217050 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.573788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.575470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.576267 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.577000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.591986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:54.603080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1376-2a11-4fa4-b44d-ae3203315f6e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:54.605546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:54.606454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:54.607250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:54.610402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 195/396] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:54.616917 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.660962 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.663264 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.663912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.665782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/95cef57c50c74ad2826ae4ae2ce66503` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.669483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56a2c8a6074cb48204eace1d91657d, group_id=ae71a3b89b5242d4891936e8fefaf7d2, role_id=95cef57c50c74ad2826ae4ae2ce66503)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.671391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.689607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 202/397] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 12 07:02:54 2022] PUT /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/95cef57c50c74ad2826ae4ae2ce66503 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:02:54.762210 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006bfe1-0135-487e-9e28-12124ef65dd0 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:54.800501 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:54.801111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:54.801396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:54.801745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:54.802515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:54.802831 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:54.804250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:54.814549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 196/398] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:54.820553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:54.959666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360762-19f2-4229-aabd-4b1c082de4d8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.000384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:55.001265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.001544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.001815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.003086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:55.004619 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:55.006689 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 203/399] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:54 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:55.014238 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:55.141745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6569f3-aff8-4847-bce4-1c81f6cccc1d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.184162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:55.185049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.185333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.185606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.186819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:55.188344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612a8f-7709-43bd-989f-c1f255b66c39 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:55.190394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 197/400] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:55 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:55.197305 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:55.208407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c18f-1e8c-4804-bffa-e369b786451c None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.208888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c18f-1e8c-4804-bffa-e369b786451c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.208960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c18f-1e8c-4804-bffa-e369b786451c None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.210554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 198/401] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:55.219722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.220030 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.220331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.254116 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:55.255396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:55.333193 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1f48-a960-4a41-b588-b586ca31d96f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.380846 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:55.381740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.382023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.382302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.385244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, group_id=ae71a3b89b5242d4891936e8fefaf7d2, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:55.386702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:55.394752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 199/402] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:55.407322 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 204/403] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 12 07:02:55 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:55.422836 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:55.539300 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e512-8cc2-4286-85cb-b3ee817904f0 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.580541 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:55.581369 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.581646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.581922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.600434 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:55.610874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:55.611835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:55.612698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 200/404] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:55.618524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:55.738295 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0cb87-da25-4c36-9891-02a1f7d385b5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.777897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:55.778575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.778857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.779128 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.779880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:55.780205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:55.781602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31acfbb-9bb5-4650-836b-9e5b471c9200 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:55.792214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 205/405] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:55.797531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:55.812916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736a82-7aa1-4c60-8aff-69b6782911e3 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.813243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736a82-7aa1-4c60-8aff-69b6782911e3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.813243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736a82-7aa1-4c60-8aff-69b6782911e3 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.814851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 206/406] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:02:55.821770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:55.822073 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:55.822474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:55.846303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:55.847641 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:55.964678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4844-622d-4fa2-871f-9f77cfef59df None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:55.970648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 207/407] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:56.006975 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.007776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.009580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.009901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.010284 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] PATH_INFO: `/v3/groups/ae34680ffe8c46e8aa55710f8ed30285` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.011741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] RBAC: Authorizing `identity:get_group(group_id=ae34680ffe8c46e8aa55710f8ed30285)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.018056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.018056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 201/408] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:55 2022] GET /identity/v3/groups/ae34680ffe8c46e8aa55710f8ed30285 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:56.021167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.146064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a60c-4a7f-4545-892e-d173fa253402 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.190019 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.190891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.191171 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.191446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] PATH_INFO: `/v3/projects/bb9a0833837c452ba8e446c72d6e4378` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.195202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb9a0833837c452ba8e446c72d6e4378)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.197527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.199437 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 202/409] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:56 2022] GET /identity/v3/projects/bb9a0833837c452ba8e446c72d6e4378 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:56.206635 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.232854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fcc6c-79da-4590-86e8-42ed732e150a None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.291666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.292413 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.292691 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.292964 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.317235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:56.338113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:56.339467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:56.340302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:56.341371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 208/410] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:02:56.347096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.403817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a27d-138b-49ac-b181-8b9ad1f770e0 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.449125 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.450046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.450363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.450637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] PATH_INFO: `/v3/projects/bb9a0833837c452ba8e446c72d6e4378/groups/ae34680ffe8c46e8aa55710f8ed30285/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.454766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb9a0833837c452ba8e446c72d6e4378, group_id=ae34680ffe8c46e8aa55710f8ed30285, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.456234 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.484791 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 203/411] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 12 07:02:56 2022] PUT /identity/v3/projects/bb9a0833837c452ba8e446c72d6e4378/groups/ae34680ffe8c46e8aa55710f8ed30285/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:02:56.535335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2da11-383d-4bb2-b9cb-c302671cc538 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.576002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.576640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.576918 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.577191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.578016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:56.578327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.579717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.589027 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 209/412] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:56.594833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.710096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594a60-2e7c-4785-9ce4-240610253716 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.749219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.750108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.750385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.750654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.751931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.753427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.755376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 204/413] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:56 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:56.762092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:56.871509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fb8e-60a1-4759-b12d-787b73dbb5f9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:56.905716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:56.906570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:56.906849 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:56.907122 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:56.908331 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:56.909766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9142e4-972e-44b0-b9d6-5f05cf72e699 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:56.911445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 210/414] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:56 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:56.917148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:57.030682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1a808-5244-4d8f-ba58-1f7fe5c7be08 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:57.066097 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:57.066987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:57.067265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:57.067540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/95cef57c50c74ad2826ae4ae2ce66503` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:57.070015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9dfa40ee4f34b4499e51c102699b41c, group_id=ae71a3b89b5242d4891936e8fefaf7d2, role_id=95cef57c50c74ad2826ae4ae2ce66503)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:57.071898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5eab3-abc3-49ae-892c-12323720dd76 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:57.092729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 205/415] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 12 07:02:56 2022] PUT /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c/groups/ae71a3b89b5242d4891936e8fefaf7d2/roles/95cef57c50c74ad2826ae4ae2ce66503 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:02:57.636438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d39a3-86f2-43e4-a8f3-ffd3d75911de None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:57.637471 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d39a3-86f2-43e4-a8f3-ffd3d75911de None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:57.637960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d39a3-86f2-43e4-a8f3-ffd3d75911de None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:57.639767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 211/416] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:57.645508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c599e-e955-4fe0-a90a-1165840481de None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:57.646327 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c599e-e955-4fe0-a90a-1165840481de None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:57.646901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c599e-e955-4fe0-a90a-1165840481de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:57.670338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-103c599e-e955-4fe0-a90a-1165840481de None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:57.671856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-103c599e-e955-4fe0-a90a-1165840481de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:57.770757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 206/417] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:02:57.817550 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d39a3-86f2-43e4-a8f3-ffd3d75911de None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:57.945852 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d39a3-86f2-43e4-a8f3-ffd3d75911de None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:57.997743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993abdc-fbf2-4516-b303-7bbd271dcec0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:57.998387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993abdc-fbf2-4516-b303-7bbd271dcec0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:57.998862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993abdc-fbf2-4516-b303-7bbd271dcec0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.000558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 207/418] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:58.009746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.009746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.009746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.009746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.012787 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.013083 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.013493 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.028727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:58.032601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:58.034632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:58.035713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 212/419] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:58.043735 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.052146 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:58.053865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:58.254727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 208/420] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:58.299588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.346470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b82e2-f5a4-4e25-8c6d-bf9c6bc7cd76 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.392764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.393444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.393730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.394012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.394767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] RBAC: Adding query filter params (name=member) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:58.395075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:58.396741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:58.407241 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 213/421] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:58.417585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.493533 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebd713-32be-452b-92bc-9fb341e6f0e4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.531586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.533231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.533525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.533810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.548785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d7750d57-8060-41ba-b2fb-05827c4c1245 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:58.559271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:58.560915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 209/422] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:58.562356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ab28-7a3a-414c-8899-95c78092a4b3 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.563658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ab28-7a3a-414c-8899-95c78092a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.563658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ab28-7a3a-414c-8899-95c78092a4b3 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.570016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 210/423] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:58.570016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.570016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.570519 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.579422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dc02-1b3d-4fab-9d03-38e143aa5630 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.593575 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:58.595169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:58.617039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.618521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.619024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.619817 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.691630 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:58.692273 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 211/424] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:58.692998 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.694608 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:58.801474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a2b2-6c00-4d46-ba71-37b4987f3244 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.810494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 214/425] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:02:58.816065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.839689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.840402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.840689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.842889 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.843693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:58.844004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:58.845453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:58.860280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 212/426] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:58.860280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:58.940916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2bbb-c336-4f9c-8bf7-38d96655a7ff None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.965935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d08476-6a0e-402e-85b6-c309435c0b4d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:58.979987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:58.981407 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:58.982124 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:58.982815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:58.995756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:02:59.003863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:02:59.004835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 07:02:59.005616 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:02:59.006219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.006219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.006219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.006219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.007005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.008608 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 215/427] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:02:59.008865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.009821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.015652 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 213/428] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:58 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:59.016981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.126241 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a762-d1df-4cdc-893a-6d200b865b5f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.126418 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6838-961d-4258-824a-3c3085123a99 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.160520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.161198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.161485 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.161768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.162527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] RBAC: Adding query filter params (name=member) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:59.162838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.163335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.164244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.164529 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.165011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.165481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.173358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 214/429] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:02:59.174200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.247257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.249214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.280161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6fb3-0735-4d55-afe3-8c551c32ff8a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.316264 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.317467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.317757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.318040 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.319650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.321352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.328065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 215/430] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:59.328065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.368454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 216/431] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:59.369571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.453372 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130fd6f-c294-4f64-961b-9b4705c43e92 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.484579 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f149c-7702-475d-a749-3dea59143fd2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.495101 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.495895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.496312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.497000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.532445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.533729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.534120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.534496 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.535797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=cc56a2c8a6074cb48204eace1d91657d) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:02:59.536270 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.538624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.556163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 217/432] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=b781ae4ae48046a1a9650d001916004e => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:59.556163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.627845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.629618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912819c3-96c6-47ae-8b95-ebe13bd6e7a9 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.699381 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd59c6-009f-4763-b815-12fd4d7b6bb3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.771554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.772627 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.772907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.773602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] PATH_INFO: `/v3/projects/cc56a2c8a6074cb48204eace1d91657d` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.776421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] RBAC: Authorizing `identity:get_project(project_id=cc56a2c8a6074cb48204eace1d91657d)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.778098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5fbf-0b1d-4ddf-ba41-65d12a06ac0e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.781029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 218/433] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/projects/cc56a2c8a6074cb48204eace1d91657d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:59.782866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4f52-bff1-4d5c-af1c-7e2e922bc3e3 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.783148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4f52-bff1-4d5c-af1c-7e2e922bc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.783422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4f52-bff1-4d5c-af1c-7e2e922bc3e3 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.784839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 219/434] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:02:59.787385 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4f52-bff1-4d5c-af1c-7e2e922bc3e3 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.802026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 216/435] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:02:59.802951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.803241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.803519 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.827387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:02:59.829142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:02:59.907824 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 217/436] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:02:59.908644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:59.924594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4f52-bff1-4d5c-af1c-7e2e922bc3e3 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:59.968904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:59.969686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:59.969967 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:59.970243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:59.972106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:59.973894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:59.975542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 220/437] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:02:59.976351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.031171 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5fbff-6581-4ef0-a17c-93ff7679bc7a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.073162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.073736 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.074014 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.074851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.076309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.077781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093e18c-3d33-4c4a-8b48-936c15206645 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.079653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 218/438] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.080758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537122-4000-4aeb-b8d0-e577689db758 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.081043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537122-4000-4aeb-b8d0-e577689db758 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.081333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537122-4000-4aeb-b8d0-e577689db758 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.082872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 219/439] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:00.083594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d537122-4000-4aeb-b8d0-e577689db758 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.099262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11914-ea80-404c-92d0-9dbf846a3fcf None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.131838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.132647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.132925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.133237 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.143032 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:00.151045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:00.152048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:00.152902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 221/440] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:00.153553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.183638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d537122-4000-4aeb-b8d0-e577689db758 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.215347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.215997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.216302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.216578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.217402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=cc56a2c8a6074cb48204eace1d91657d) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:00.217707 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.219171 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad03f6a-9189-492c-ae6f-d059036dc15e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.225163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 220/441] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=cc56a2c8a6074cb48204eace1d91657d&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.226282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.226568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.227406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.245674 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:00.246897 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:00.251088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e175-ce5d-4478-ba66-b10b6b5f78da None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.292843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.294034 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.294382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.294666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.298060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.299831 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.308051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 222/442] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.308051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.319722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 221/443] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:00.320941 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.434433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c3348-45f1-43e7-b20b-eacfb3fa4351 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.437707 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404d83f-2f08-4df3-9aae-a84fbd73eeff None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.474458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.475480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.475763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.476053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.477000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=b781ae4ae48046a1a9650d001916004e, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:00.477317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.478986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.480338 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.481069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.481353 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.481628 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.482899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:00.483361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.484804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.485346 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 222/444] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=b781ae4ae48046a1a9650d001916004e => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.485936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.496723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 223/445] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.502761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.608413 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038822ca-8748-4bc4-87b0-61ded9688036 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.637905 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165515-d2da-4d23-bf9c-3a5da1c3dafa None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.658277 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.659108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.659393 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.659668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.671888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:00.680752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:00.681753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 07:03:00.682525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:00.683108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.683108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.683257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.683532 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.684995 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 223/446] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:00.691405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.756412 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.758981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.795484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a84e69-cfff-46fc-be50-4fb4c2048938 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.829945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.830626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.830908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.831187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:00.831935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:00.832280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:00.833667 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:00.842066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 224/447] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:00.847303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.862212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 224/448] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:03:00.867988 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:00.951108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6649c-ac2e-4b9c-9eeb-f31559a9dd5b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.971201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09c10-4fe2-4282-9665-ff6e9667b4d8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:00.984017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:00.984693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:00.984978 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:00.985256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.002818 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.003655 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.003927 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.004227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] PATH_INFO: `/v3/projects/bb9a0833837c452ba8e446c72d6e4378` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.005383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] RBAC: Authorizing `identity:get_project(project_id=bb9a0833837c452ba8e446c72d6e4378)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.006859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.009452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 225/449] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/projects/bb9a0833837c452ba8e446c72d6e4378 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:01.015524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:01.050255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.051720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.108901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d85b1f-663f-4dee-94d9-605bbd6d129b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:01.140620 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.141547 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.141838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.142112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] PATH_INFO: `/v3/groups/ae34680ffe8c46e8aa55710f8ed30285` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.143284 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] RBAC: Authorizing `identity:get_group(group_id=ae34680ffe8c46e8aa55710f8ed30285)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.144768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.146380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 226/450] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:03:01 2022] GET /identity/v3/groups/ae34680ffe8c46e8aa55710f8ed30285 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:01.151614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 225/451] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:03:01.152729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:01.152879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:01.245787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398780-c1d2-4893-b14c-dd6de570d85f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:01.245987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbe873-054e-483f-a52f-cc06d22bff1c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:01.278465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.278660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.279196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.279290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.279481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.279600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.279756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.279884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] PATH_INFO: `/v3/projects/d9dfa40ee4f34b4499e51c102699b41c` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.280623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] RBAC: Adding query filter params (group.id=ae34680ffe8c46e8aa55710f8ed30285, role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=bb9a0833837c452ba8e446c72d6e4378) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:01.280935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.281093 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] RBAC: Authorizing `identity:get_project(project_id=d9dfa40ee4f34b4499e51c102699b41c)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.282364 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.282531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.284252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 227/452] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 12 07:03:01 2022] GET /identity/v3/projects/d9dfa40ee4f34b4499e51c102699b41c => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:01.288055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 226/453] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:03:01 2022] GET /identity/v3/role_assignments?group.id=ae34680ffe8c46e8aa55710f8ed30285&scope.project.id=bb9a0833837c452ba8e446c72d6e4378&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:01.290260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:01.393920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f84ecc-5662-4c55-a326-e0f5812f14de None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:01.429300 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.430459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.430691 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.430969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] PATH_INFO: `/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.432265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] RBAC: Authorizing `identity:get_group(group_id=ae71a3b89b5242d4891936e8fefaf7d2)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.433749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef160e0-1982-4a32-b569-cf45c7d6c74a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.435463 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 228/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 12 07:03:01 2022] GET /identity/v3/groups/ae71a3b89b5242d4891936e8fefaf7d2 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:01.441391 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:01.540764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9590-9bf3-4082-ae41-adb8e871ade2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:01.572669 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:01.573318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:01.573608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:01.573890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:01.574719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] RBAC: Adding query filter params (group.id=ae71a3b89b5242d4891936e8fefaf7d2, role.id=95cef57c50c74ad2826ae4ae2ce66503, scope.project.id=d9dfa40ee4f34b4499e51c102699b41c) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:01.575034 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:01.576599 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417690-a67f-47bb-9db8-a186175f1888 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:01.582146 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 227/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 12 07:03:01 2022] GET /identity/v3/role_assignments?group.id=ae71a3b89b5242d4891936e8fefaf7d2&scope.project.id=d9dfa40ee4f34b4499e51c102699b41c&role.id=95cef57c50c74ad2826ae4ae2ce66503 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:04.329478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b92ae-e521-4598-bbe4-5721f3c15be6 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.330005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b92ae-e521-4598-bbe4-5721f3c15be6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.330005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b92ae-e521-4598-bbe4-5721f3c15be6 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.331638 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 229/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:04.338086 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51dac-c313-4f16-949c-b974b853f6d4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.338499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51dac-c313-4f16-949c-b974b853f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.338664 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51dac-c313-4f16-949c-b974b853f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.356764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-9da51dac-c313-4f16-949c-b974b853f6d4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:04.357947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-9da51dac-c313-4f16-949c-b974b853f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:04.434785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 228/457] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:04.461067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b92ae-e521-4598-bbe4-5721f3c15be6 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:04.513136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afe3f-b2de-416e-a379-12afc2b11b0a None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.513761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afe3f-b2de-416e-a379-12afc2b11b0a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.514279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afe3f-b2de-416e-a379-12afc2b11b0a None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.515857 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 229/458] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:04.521334 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ab55-cd6e-4f1a-ac87-9861c8d93b34 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.521849 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ab55-cd6e-4f1a-ac87-9861c8d93b34 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.522321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ab55-cd6e-4f1a-ac87-9861c8d93b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.540036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-0d38ab55-cd6e-4f1a-ac87-9861c8d93b34 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:04.541616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-0d38ab55-cd6e-4f1a-ac87-9861c8d93b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:04.568325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b92ae-e521-4598-bbe4-5721f3c15be6 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:04.603348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:04.604490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.604932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.605351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.614468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 230/459] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:04.614468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d2d5-b9d0-402a-9815-4f881292be71 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.614468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d2d5-b9d0-402a-9815-4f881292be71 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.620469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:04.620558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d2d5-b9d0-402a-9815-4f881292be71 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.620627 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:04.620691 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 231/460] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:04.624640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.624929 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.625202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:04.637456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:04.638358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:04.639265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:04.639265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:04.639265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.639265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:04.639265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 230/461] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:04.644838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:04.647133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:04.648600 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:04.714370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 232/462] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:04.715070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:04.758156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2ef4b-8274-42ce-9f5f-75fdd60c907e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:04.791683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:04.792381 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.792663 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.792938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.793650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:04.793949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:04.795317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:04.812115 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 231/463] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:04.812959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:04.819243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fb964-a0ce-417f-9fee-7ce2046f871c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:04.854190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:04.855201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.855638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.855912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.865712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:04.868071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:04.886050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:04.887039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:04.887880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:04.887880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:04.887880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.887880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:04.891956 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 233/464] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:04.892672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:04.911890 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906269-c6a0-4075-b189-d5de3f262711 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:04.947262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:04.948250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:04.948531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:04.948804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:04.958569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:04.960229 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:04.978216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:04.979143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:04.979979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:04.979979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:04.979979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:04.979979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:04.979979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 232/465] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:04.980263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.010470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dead-9d38-4d23-84e1-104f94e3204a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.042260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.042930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.043212 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.043487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.044338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.045772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3448187-c853-43f3-8f64-3984d5086374 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.066989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 234/466] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:03:04 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:05.068337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d857b-97d9-4587-aa0c-4b9d056b8b66 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.068617 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d857b-97d9-4587-aa0c-4b9d056b8b66 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.068899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d857b-97d9-4587-aa0c-4b9d056b8b66 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.071037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 235/467] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:05.071620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d857b-97d9-4587-aa0c-4b9d056b8b66 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.094348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3efb-3e4e-4cf1-a13c-2de59ddfe0ee None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.135439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.136040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.136384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.136670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.137419 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:05.137721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.139177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a94f-213d-4326-a809-9e775b474d1c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.158157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 233/468] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:05.158157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.158157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.158157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.174256 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:05.175529 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:05.187299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d857b-97d9-4587-aa0c-4b9d056b8b66 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.222018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.222702 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.223245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.223526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.224299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:05.224609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.226019 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.239084 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 236/469] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:05.245160 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.249558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 234/470] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:05.250600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.356078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cab57-2e2a-405e-a867-473d4fe2c23b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.368749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8081-182b-45a1-a034-b4f69aa649c0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.391846 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.392554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.392837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.393115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.393820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.395255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.401545 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.402398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.403020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.403020 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.403876 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.405092 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.415735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 237/471] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:03:05 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:05.422302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.428767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 235/472] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:03:05 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:05.553519 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750f36-f482-41b2-8088-892c71a4b41b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.594719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.595851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.596385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.596813 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.610743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.612684 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:05.633819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:05.634924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:05.636006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:05.636006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:05.636006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:05.636006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:05.638259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 238/473] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:05.644751 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.760536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ecd95-1929-4f6c-929b-24a6b6181ff3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.794639 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.795304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.795582 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.795857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.796650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:05.796955 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.798319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309b212-3bd5-4973-9bb8-f2399e7db03a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.810650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 236/474] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:05.815981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:05.914611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0bee5-0b92-47ce-870f-a83fe866a967 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:05.948548 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:05.949233 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:05.949513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:05.949783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:05.950505 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:05.951934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582dd90-f3ce-4ce5-b601-e7fbf80bc428 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:05.973381 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 239/475] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:03:05 2022] POST /identity/v3/users => generated 249 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:07.565213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5490-ce13-4f87-9656-18827a45d8ce None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:07.565740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5490-ce13-4f87-9656-18827a45d8ce None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:07.565814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5490-ce13-4f87-9656-18827a45d8ce None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:07.567422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 237/476] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:07.573361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:07.573772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:07.573965 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:07.591404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:07.592650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:07.661197 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 240/477] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:07.694594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5490-ce13-4f87-9656-18827a45d8ce None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:07.816765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5490-ce13-4f87-9656-18827a45d8ce None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:07.853188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:07.853991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:07.854282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:07.854560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:07.865368 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-07c5cc84-36a5-42e0-a41e-95bea9599228 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:07.873986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:07.874895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:07.875679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 238/478] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:07.881338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:07.923517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb553-09c4-42e1-b414-e4af54b49601 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:07.923822 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb553-09c4-42e1-b414-e4af54b49601 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:07.924074 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb553-09c4-42e1-b414-e4af54b49601 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:07.925610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 239/479] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:07.931484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86280c3-416d-4a79-a33b-d3473859a0eb None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:07.931765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86280c3-416d-4a79-a33b-d3473859a0eb None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:07.932042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86280c3-416d-4a79-a33b-d3473859a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:07.950289 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e86280c3-416d-4a79-a33b-d3473859a0eb None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:07.951416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e86280c3-416d-4a79-a33b-d3473859a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:07.994035 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0dcc3-2af3-4a11-b9d7-a85fbeb429ac None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.022464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 240/480] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:08.024487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81a68-b5dc-432e-90be-ce3c8300b3a2 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.024987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81a68-b5dc-432e-90be-ce3c8300b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.025943 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81a68-b5dc-432e-90be-ce3c8300b3a2 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.027436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 241/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:08.033532 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.034151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.034742 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.035608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.036365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.036655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.036937 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.037695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:08.038006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.039622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.048614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 241/482] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:08.049443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.055330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:08.056900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:08.123230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 242/483] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:08.123949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.164420 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861815ab-9fd2-4a41-97fe-2f5d55f9f0ab None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.198692 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.199491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.199779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.200043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.210197 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:08.218423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.219516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:08.220451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 242/484] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.224999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.237556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5af0-1b6a-4b77-9864-da8c425d7790 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.270679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.271457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.271737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.272008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.282445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.283896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:08.300776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.301670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.302525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:08.302525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:08.302525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.302525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:08.302525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 243/485] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.302801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.335626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e8c7-6d93-45a0-b095-cff89254cfb8 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.368595 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.369385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.369672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.369953 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.379543 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:08.388325 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.389205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:08.389993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 243/486] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.390714 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.406988 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f7706-7f5b-42dc-9773-19fe9dd44be9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.442665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.443334 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.443608 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.443907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.444792 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:08.445597 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.447014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274b65f-76e3-41c2-bca9-b1efe6343cc1 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.454844 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 244/487] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:08.460600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a716-2b9b-4a43-b0f0-1323ec1e3bd0 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.460892 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a716-2b9b-4a43-b0f0-1323ec1e3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.461682 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a716-2b9b-4a43-b0f0-1323ec1e3bd0 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.462991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 245/488] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:08.467811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8a716-2b9b-4a43-b0f0-1323ec1e3bd0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.486492 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef50ff0-aebb-4289-bc5a-1fd4bee9c71f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.518809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.519468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.519751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.520029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.520788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:08.521096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.522472 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.534393 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 244/489] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:08.535192 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.563879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8a716-2b9b-4a43-b0f0-1323ec1e3bd0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.596504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.597143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.597425 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.597702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.598694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:08.599000 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.600383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a0c2-bb1c-4dae-b343-852dc4c6591a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.608147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 246/490] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:08.609396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.609687 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.609982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.626162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:08.627351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:08.628394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26df7-ba0e-4e72-a012-5c3d9573077f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.660848 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.661634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.662024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.662323 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.672137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.673596 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.689990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 247/491] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:08.690814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:08.691339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.692165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.693045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:08.693045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:08.693045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.693045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:08.693045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 245/492] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.693630 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.785075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ec40-174c-4073-b128-8687154df7f0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.791997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bd3d5-8af7-4a34-a41c-5bb90b0840f2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.817887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.818668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.818947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.819221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.824019 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.824833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.825120 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.825401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.826236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.827679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.835060 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.837148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:08.843648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.844536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:08.845430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 248/493] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.846011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:08.855549 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:08.856458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:08.857286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:08.857286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:08.857286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:08.857286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:08.857286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 246/494] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:08.857566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:08.943035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54677f-0bc4-436b-8604-89048ea8efcc None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.949614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d25b4f-ae4d-4761-b87a-b9398a5d437c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:08.975460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.976109 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.977036 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.977329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.978046 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:08.978349 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:08.979738 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:08.983773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:08.984603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:08.984881 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:08.985224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:08.995540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:08.995695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 249/495] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:08.996473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:09.003349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:09.004360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 247/496] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:09.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.110734 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f1703-a4d3-4f5e-8f9b-dd5667701b61 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.113963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6af5-004f-4739-aea4-3ef5067a444b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.158921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.159576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.159853 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.159946 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.160206 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.160620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.160904 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.161034 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:09.161181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.161343 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.161898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:09.162205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.162836 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.163603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.175206 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 248/497] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:09.176060 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.203981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 250/498] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:09.203981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.271000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e14c7-b841-473f-89a2-9648ef1d321a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.292910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeef20-346f-490e-9a8f-1ce81c5699ac None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.303125 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.303916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.304229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.304537 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.311662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.313133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.324466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.325116 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.325397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.325668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.326403 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:09.326783 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.328161 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:09.329163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:09.330193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 249/499] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:09.336473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.341510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 251/500] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:09.341510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.437791 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c668c7-5e22-4b11-af16-a0bc16488b38 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.448635 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb193-652d-4c17-b220-4fe1959e6a95 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.470605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.471396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.471693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.471950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.479683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.481168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.482465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.483113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.483404 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.483680 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:09.495366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:09.496314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 250/501] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:09.501353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.549597 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.551069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.591402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a17c-e574-46be-b97d-38d57406c725 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.623638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.624332 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.624608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.624879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.625701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:09.626004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.627425 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.643786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 252/502] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:09.644665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.665456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 251/503] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:09.666285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.738108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa6fc8-55c2-4641-9807-49322b44aa36 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.759602 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca771-3e51-4475-814c-403b5658fff7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.770129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.770916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.771194 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.771462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.781821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.783254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.792812 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.793478 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.793761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.794039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.794867 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:09.795176 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.796647 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:09.799802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:09.800867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:09.801720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:09.801720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:09.801720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:09.801720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:09.801720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 253/504] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:09.803047 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.818075 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 252/505] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:09.818075 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:09.896550 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6778-d52b-46f4-886c-aa5b4f094706 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.911594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c510-c937-435e-a01a-9daa8298d4e5 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:09.927996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.928799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.929082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.929357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.939545 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:09.941037 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:09.943511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:09.944169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:09.944452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:09.944724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:09.958273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:09.959244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:09.960079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:09.960079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:09.960079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:09.960079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:09.960079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 254/506] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:09.960376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.011138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.012570 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.059561 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae41168-68a6-4f86-8eb8-fa820a595b08 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.092551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.093201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.093484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.093759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.094487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:10.094794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.096250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.106312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 253/507] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:10.107147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.109181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 255/508] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:10.109983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.200234 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9b3ba-ed40-4d30-b67a-a79f9b0ca9fa None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.204759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c5e32-dc58-437a-a53e-1a48107fe105 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.232204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.232847 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.233128 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.233404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.237139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.237780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.238059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.238334 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.239053 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:10.239356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.240760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.252392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 256/509] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:10.253171 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.298569 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.299945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.351140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765725f-fcf5-46ed-a1c4-d2205a4bbbfb None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.384024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.384833 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.385111 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.385385 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.392835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.394275 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.395572 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 254/510] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:10.396446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:10.413378 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:10.414306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:10.415255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 257/511] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:10.415801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.497437 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1d25-bac4-41a0-aba2-6da21ca7b7ba None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.518365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28d0f-034d-4512-a168-4e52e293bb50 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.529084 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.529947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.530230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.530503 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.541173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.542628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.550591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.551316 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.551599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.551877 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.558865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.560329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:10.560438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:10.561250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:10.562138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:10.562138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:10.562138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:10.562138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:10.562138 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 255/512] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:10.562392 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:10.576187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:10.577070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:10.577889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 258/513] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:10.578348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.664623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbc5b-c492-43c7-86dd-a6b2aebecc3b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.671753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b658-1986-4a34-add5-c71e1c78af05 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.696495 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.697274 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.697544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.697820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.704226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.704882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.705164 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.705443 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.706273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:10.706581 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.707736 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.708010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.709213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.724769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 259/514] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:10.725566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:10.725810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:10.727141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:10.727993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:10.727993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:10.727993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:10.727993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:10.727993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 256/515] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:10.728302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.824043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746edc76-0633-44f1-940f-298a3d39e2de None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.824476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2768-66f6-4ab8-b39d-6b525a77aa4a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.857004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.857671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.857922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:10.858042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.858220 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.858568 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:10.858847 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:10.859005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:10.859141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:10.859314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.859815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:10.860149 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:10.860790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.861500 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:10.872307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 260/516] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:10.873095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.882754 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 257/517] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:10.882754 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:10.967935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba68a6-f835-4702-adea-281b66aaa291 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.973460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ed-aef4-4d39-b9a5-b37a3126681c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:10.999524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.000185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.000466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.000735 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.005868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.006526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.006811 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.007089 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.007808 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.008137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.009520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.020319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 258/518] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.021112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.069388 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.070880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.116356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d7a4-df9a-4139-8730-c1698fe6134e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.148649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.149608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.149899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.150182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.156678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.158114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.164650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 261/519] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:11.165481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:11.172803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:11.173683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:11.174517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 259/520] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:11.174993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.263336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890d77-2133-4951-991f-ee9186cb9339 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.272775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cba00-aa8f-427a-9ea7-3df58698af80 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.296303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.296947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.297228 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.297501 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.298316 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=61fa2aa07d994d02867b8bafc7ff2644) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.298623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.300042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.306114 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 262/521] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/role_assignments?user.id=61fa2aa07d994d02867b8bafc7ff2644&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.306231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.306727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.307061 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.307349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.307624 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.318158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.319654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:11.335260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:11.336690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:11.337597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 260/522] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:11.338078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.428714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be611f-76d6-437b-91d7-55aa9273d007 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.454565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23632719-4e3a-40b7-860d-f531f6b4a8eb None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.467252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.468057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.468402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.468899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.480966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.482463 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.492754 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.493736 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.494026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.494301 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.495093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.495896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.496862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:11.502542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:11.503382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:11.504301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:11.504301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:11.504301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:11.504301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:11.505414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 263/523] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:11.506284 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.511451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 261/524] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.512329 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.606634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654f469-6ace-4c79-8a00-b241c9a43dc7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.615387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528351-0cc1-4d00-8681-a93a1104270d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.640431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.641084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.641363 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.641645 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.642417 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.642725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.644187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.649554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.649967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.650246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.650521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.651240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.651548 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.652946 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.668560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 264/525] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.668560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.668790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 262/526] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.669453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.766553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87d48-2539-442f-b3dc-7449918e0eef None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.767169 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299c27c-df42-4e1e-ac7b-6ea555f01ba6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.801560 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.802222 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.802502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.802883 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.803095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.803603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=3c9ac81291744cc1aca09035350296c6) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.803764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.803943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.804031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.804373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.805209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=395edc9a3a5c4dc2b4dcc4f2a4d5e330) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:11.805441 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.805547 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.807003 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.811147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 263/527] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/role_assignments?user.id=3c9ac81291744cc1aca09035350296c6&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:11.811853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:11.824587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 265/528] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/role_assignments?user.id=395edc9a3a5c4dc2b4dcc4f2a4d5e330&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:11.931313 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e671-e8b1-4f1f-a39d-f8bdc89fbb1a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:11.969771 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:11.970603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:11.970882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:11.971156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:11.980159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:11.981680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:11.997963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:11.998872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:11.999690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 264/529] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:12.005415 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:12.109715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3711b-8e13-4869-9834-ef0418257dfb None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:12.148308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:12.149361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:12.149839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:12.150306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:12.151284 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:12.151809 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:12.153460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91eb79-4475-43e7-8fce-9547c6f82acf None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:12.167300 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 266/530] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:12.172959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:12.273104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb9095-5d60-4a35-88fc-0cd339f7fe09 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:12.307080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:12.307734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:12.308015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:12.308316 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:12.309148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=015718a382044581ba4fceb50c466ea0) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:12.309455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:12.310888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15addb-d73c-426b-a9c4-4bb942d358b4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:12.320270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 265/531] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:12 2022] GET /identity/v3/role_assignments?user.id=015718a382044581ba4fceb50c466ea0&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:13.697914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff43a4-e552-4404-90d4-e9c656ea0bc5 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:13.698401 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff43a4-e552-4404-90d4-e9c656ea0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:13.698401 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff43a4-e552-4404-90d4-e9c656ea0bc5 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:13.699998 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 267/532] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:13.705608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:13.706075 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:13.706154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:13.725984 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:13.727693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:13.795684 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 266/533] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:13.820457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff43a4-e552-4404-90d4-e9c656ea0bc5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:13.924348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff43a4-e552-4404-90d4-e9c656ea0bc5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:13.961308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:13.962432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:13.962916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:13.963408 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:13.974182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:13.982251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:13.983139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:13.983925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:13.986589 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 268/534] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:13.993161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.104822 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6994d-9949-4f01-9c77-9405f9e92c1f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.140087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.140796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.141076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.141353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.142112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:14.142411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.143782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf172be-9c7f-490e-b054-a4aa3c1745e1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.152648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 267/535] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:14.158391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.222059 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460ec1-d201-4434-af7e-eb251b6b2eed None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.222355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460ec1-d201-4434-af7e-eb251b6b2eed None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.222544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460ec1-d201-4434-af7e-eb251b6b2eed None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.224499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 268/536] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:14.229476 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9d73-9b44-4fc3-b642-b0a0b90d4574 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.229776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9d73-9b44-4fc3-b642-b0a0b90d4574 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.230058 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9d73-9b44-4fc3-b642-b0a0b90d4574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.248245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-da2a9d73-9b44-4fc3-b642-b0a0b90d4574 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:14.249443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-da2a9d73-9b44-4fc3-b642-b0a0b90d4574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:14.265149 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300497-71ba-4404-a4b8-539c09ed3c55 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.298596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.299382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.299662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.299938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.310911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.312517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.318788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 269/537] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:14.326654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e389-4e86-46ba-87dc-1c12b59c29cc None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.327343 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e389-4e86-46ba-87dc-1c12b59c29cc None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.328013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e389-4e86-46ba-87dc-1c12b59c29cc None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.329796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 270/538] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-1cb524d5-9100-4cfd-b430-af780f5615ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:14.331097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:14.331932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:14.332830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:14.332830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:14.332830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:14.332830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:14.337512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 269/539] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:14.338586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e389-4e86-46ba-87dc-1c12b59c29cc None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.339126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.339470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.339881 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.358931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:14.360169 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:14.444152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 270/540] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:14.444152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.460166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e389-4e86-46ba-87dc-1c12b59c29cc None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.493536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.494123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.494409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.494685 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.495410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:14.495720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.497141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.515768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 271/541] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:14.515768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.552532 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b21cf5-cc6e-4603-baf3-ac77796cc8cc None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.587574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.588411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.588695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.588976 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.599725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:14.607513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:14.608480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:14.609534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 271/542] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:14.610317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.626753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfa3b-8738-431a-b37e-12233c3db825 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.660681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.661476 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.661787 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.662067 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.672275 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:14.681102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:14.681970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:14.682758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 272/543] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:14.684006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.708246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce71f16-3b67-4852-b41f-70a6293a6321 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.739971 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.740787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.741065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.741341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.749071 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.750438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-7c77e36b-495b-4551-9d8c-61a22ecda8fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:14.764770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:14.765889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:14.766791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 272/544] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:14.767602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512af0-7b17-4e69-a17a-9b84fe038b43 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.767602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512af0-7b17-4e69-a17a-9b84fe038b43 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.767739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512af0-7b17-4e69-a17a-9b84fe038b43 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.768884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 273/545] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:14.769579 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9512af0-7b17-4e69-a17a-9b84fe038b43 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.782734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17e0c-01a0-4334-8e7f-9e7c8997f9c5 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.816000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.816697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.816985 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.817265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.818015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:14.818330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.819729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.828016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 273/546] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:14.828815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:14.866494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9512af0-7b17-4e69-a17a-9b84fe038b43 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.900314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.900981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.901266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.901546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.902287 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:14.902604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.903962 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb76c16-85cf-4dcb-b584-f190f90e3156 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.911757 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 274/547] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:14.912986 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.913277 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.913584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.929714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:14.930867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:14.949692 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138843b-a015-4108-ab16-6bb518d4469b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:14.987607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:14.988303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:14.988584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:14.988858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:14.989684 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:14.989993 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:14.991411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:14.995530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 275/548] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:14.996391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.009405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 274/549] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:15.010014 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.093304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1cce3-ec9d-4334-843f-6a4c24c21907 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.104331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57da8a-67f9-4e3b-a2d9-d08bc2e2a3f1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.128113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.128923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.129203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.129479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.137705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.138494 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.138775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.139054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.139688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.141180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.149205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.150633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:15.158674 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.159492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 276/550] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.160764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:15.173636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.174657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 275/551] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.180967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.255787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473be2-9724-430e-96e6-309f978bd877 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.276006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be23-b977-48f4-8ea5-ac3e35704f22 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.291665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.292490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.292775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.293051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.304845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.306740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.309935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.310728 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.311012 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.311290 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.321511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:15.324789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.325767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 277/552] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.336535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:15.337095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.338283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 276/553] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.339254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.426057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cac4d-5184-4af5-a8c3-dc2e1cdf1b78 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.431866 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f91b-e7f8-4c46-a03d-908108653d2b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.459610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.461245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.461522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.461803 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.462506 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:15.462807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.464179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.465220 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.466047 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.466760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.467048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.467794 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:15.468098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.469486 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.475308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 278/554] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:15.476972 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.487176 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 277/555] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:15.487176 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.577439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fbc4-95bb-43d8-a645-44ab6d19ba71 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.577628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48031a1-6cb4-48bc-9beb-b3b6fdbeb7b1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.607949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.608251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.608626 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.608902 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.608991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.609175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.609267 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.609445 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.609885 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:15.610183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:15.610287 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.610485 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.611534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.611821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.620252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 278/556] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:15.621055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.627842 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 279/557] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:15.627842 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.717303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89c72-9436-4501-b963-614ef870fbcb None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.719351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943bbd-b975-4c6b-8c23-1b09a9d1f849 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.750580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.751358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.751635 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.751895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.751999 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.752708 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.752989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.753264 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.759212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.760682 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.760974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.762390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:15.776101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.777060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:15.777946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:15.778464 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.779240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:15.780180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:15.780774 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 280/558] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.780840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 279/559] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.780840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.782749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.874781 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e959-7a57-49de-ae7d-1414a0262107 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.877438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35411-be6f-470e-9c4d-55e6d7c19c2c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:15.907370 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.908215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.908487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.908781 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.909730 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:15.910527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:15.910809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:15.911087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:15.917715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.918600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:15.919163 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.920017 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:15.933123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.933931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:15.934751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 280/560] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.935197 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:15.936951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:15.937888 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 281/561] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:15.940366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.032592 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6808f-c394-48a8-abe7-ae870c19f427 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.035532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b140e-720a-4ac4-bf57-86dc60e45049 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.065636 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f667a-6839-4560-baf0-b85183221291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.066384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f667a-6839-4560-baf0-b85183221291 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.066733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f667a-6839-4560-baf0-b85183221291 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.067072 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f667a-6839-4560-baf0-b85183221291 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.067968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f667a-6839-4560-baf0-b85183221291 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.068582 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.068724 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f667a-6839-4560-baf0-b85183221291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.069411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.070253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.070662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.071041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f667a-6839-4560-baf0-b85183221291 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.071817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.072217 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.074312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.088791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 282/562] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.089602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f667a-6839-4560-baf0-b85183221291 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.092208 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 281/563] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.093627 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.183462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f667a-6839-4560-baf0-b85183221291 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.186447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c61df-95c9-469e-b427-97a0e2eda4be None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.215283 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.215929 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.216231 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.216506 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.217278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.217579 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.218053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.218701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.218981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.219080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.219256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.219965 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.220302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.221640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.230910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 283/564] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.231682 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.237686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 282/565] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.237686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.326146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad601-9efe-49c3-aa6d-b9df44a52ed7 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.328555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738736ff-f414-49f4-8c67-d4225b975190 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.358342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.359243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.359534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.359812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.360424 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.361203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.361489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.361768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.370834 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.372361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.372462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.373793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:16.389566 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:16.390611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:16.391458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:16.391458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:16.391458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:16.391458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:16.391458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 284/566] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:16.391719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:16.395132 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:16.396422 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:16.396422 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:16.396422 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:16.396422 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:16.396660 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.396740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 283/567] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:16.396740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.490855 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ce3bf-83e5-4523-83a0-ee481eb4b268 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.493284 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180feb1-ddf4-453b-8478-308fd04afda9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.522587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.523441 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.523724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.524005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.524326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.525197 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.525474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.525753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/61fa2aa07d994d02867b8bafc7ff2644/roles/a13acf77e55448d0b01cacc060e5e212` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.532045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.533534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.540660 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=61fa2aa07d994d02867b8bafc7ff2644, role_id=a13acf77e55448d0b01cacc060e5e212)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.542101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:16.548968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:16.549974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:16.550890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 284/568] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:16.551523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.560825 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 285/569] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:03:16 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/61fa2aa07d994d02867b8bafc7ff2644/roles/a13acf77e55448d0b01cacc060e5e212 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:03:16.561828 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.659345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721a152-be59-47ec-b37d-bda438ef0cfc None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.671523 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004391-f79e-4186-846a-e3c77450d6a8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.694989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.695801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.696082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.696418 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.697123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.697431 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.698836 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.708556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.709231 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.709512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.709786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.710671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.710897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.712473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.717223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 285/570] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.717223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.725684 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 286/571] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.731449 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.814068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485027d-9fa0-469f-8a93-d692caf39b4d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.833609 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b954-95ee-4a6b-94f0-e8096e10110d None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.847441 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.848535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.848819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.849180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.849938 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:16.850249 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.852650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.867950 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:16.868769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:16.869050 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:16.869323 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:16.869872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 286/572] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:16.870527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.877425 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:16.878878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:16.892780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:16.893716 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:16.894653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 287/573] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:16.895156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:16.975724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ef93-60c8-4740-98ff-a217068ed988 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:16.990588 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aa353-b5b1-4037-841e-702f3821ae5e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.010405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.011205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.011490 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.011769 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.018827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.020370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.023996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.024814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.025152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.025427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:17.034622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:17.035613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:17.041701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:17.042119 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.042201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 287/574] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:17.042278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.042359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:17.058307 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:17.064435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 288/575] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:17.065432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.149924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6b6e-0bfa-484a-9138-05fa1ef2f8fb None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.156678 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c92a6-7a4f-4414-b1a7-d0dbae1eb06e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.184499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016736ec-872d-474b-a094-482f43994f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.185236 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016736ec-872d-474b-a094-482f43994f9e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.185596 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016736ec-872d-474b-a094-482f43994f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.185945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016736ec-872d-474b-a094-482f43994f9e None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.186807 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016736ec-872d-474b-a094-482f43994f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:17.187189 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016736ec-872d-474b-a094-482f43994f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.188832 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016736ec-872d-474b-a094-482f43994f9e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.192035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.192772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.193120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.193460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.194309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:17.194911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.196446 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.205903 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 288/576] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:17.205903 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016736ec-872d-474b-a094-482f43994f9e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.211744 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 289/577] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:17.216549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.311457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016736ec-872d-474b-a094-482f43994f9e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.312710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9918c-0438-4fad-82f6-7a099ccb6556 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.343971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.344222 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.344665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.344945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.345130 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.345240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.345397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.345630 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/3c9ac81291744cc1aca09035350296c6/roles/a13acf77e55448d0b01cacc060e5e212` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.345924 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:17.346225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.347588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.359763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 289/578] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:17.360417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.366018 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=3c9ac81291744cc1aca09035350296c6, role_id=a13acf77e55448d0b01cacc060e5e212)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.367507 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.388174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 290/579] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:03:17 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/3c9ac81291744cc1aca09035350296c6/roles/a13acf77e55448d0b01cacc060e5e212 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:03:17.388174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.483701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a74dc-92aa-44df-8724-4da41574abca None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.522468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.523798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.524215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.524564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/395edc9a3a5c4dc2b4dcc4f2a4d5e330/roles/a13acf77e55448d0b01cacc060e5e212` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.534822 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec90f75-14bc-4f41-84a2-842e6f60b7e6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.544643 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=395edc9a3a5c4dc2b4dcc4f2a4d5e330, role_id=a13acf77e55448d0b01cacc060e5e212)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.546842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.568383 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 290/580] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:03:17 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/395edc9a3a5c4dc2b4dcc4f2a4d5e330/roles/a13acf77e55448d0b01cacc060e5e212 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:03:17.578019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.578861 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.579195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.580103 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.589435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.591029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:17.607658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:17.608647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:17.609530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 291/581] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:17.615361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.732989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd78f-31b9-45b2-8776-39005c1cb6d5 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.769834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.770843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.771285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.771737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.772712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:17.773702 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.775463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905c636-17ee-4809-b28e-aea9489c5f72 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.789386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 291/582] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:17.798705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:17.907236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fe19-da58-4014-adb2-2668b3f71650 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:17.942195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:17.943454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:17.943924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:17.944427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/015718a382044581ba4fceb50c466ea0/roles/a13acf77e55448d0b01cacc060e5e212` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:17.960968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=015718a382044581ba4fceb50c466ea0, role_id=a13acf77e55448d0b01cacc060e5e212)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:17.962840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd75e87-dcb6-4a3f-a4f1-61c8c7146b64 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:17.977570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 292/583] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:03:17 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/015718a382044581ba4fceb50c466ea0/roles/a13acf77e55448d0b01cacc060e5e212 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:03:18.896260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68aaf3-1886-4fa9-b270-08697fe49bc7 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:18.896785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68aaf3-1886-4fa9-b270-08697fe49bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:18.896880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68aaf3-1886-4fa9-b270-08697fe49bc7 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:18.898562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 292/584] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:18.904148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:18.904567 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:18.904721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:18.921984 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:18.923176 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:18.996232 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 293/585] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:19.017322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68aaf3-1886-4fa9-b270-08697fe49bc7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.123058 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68aaf3-1886-4fa9-b270-08697fe49bc7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:19.158671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:19.159394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.159678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.159954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.170327 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:19.178031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:19.179902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:19.181639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:19.184916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 293/586] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:19.185922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.285623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cdc00-2301-447a-8f60-fd684ee1d6ae None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:19.320576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:19.321249 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.321528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.321781 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.322538 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:19.322865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:19.324223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:19.332973 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 294/587] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:19.339078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.445971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3e26-da3d-4259-9ebe-2fc06478fc6a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:19.481230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:19.481959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.482235 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.482510 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.493333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:19.494790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:19.512291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:19.514396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:19.516592 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:19.516592 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:19.516592 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:19.516592 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:19.520168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 294/588] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:19.521555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.622835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40b0f-3c67-43a3-b334-b843ed19c48b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:19.661533 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:19.662454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.662881 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.663300 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.664232 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:19.664707 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:19.666235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4239b-37bc-4f36-a6e7-7bbac2583a8e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:19.683160 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 295/589] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:19.684750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.792875 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021c0ad-152f-41cf-8995-7c0e3947b010 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:19.827461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:19.828586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.829035 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.829651 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.831246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822860a0-f92e-4f91-9b10-584b24e982f2 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.831528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822860a0-f92e-4f91-9b10-584b24e982f2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.831799 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822860a0-f92e-4f91-9b10-584b24e982f2 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.833465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 296/590] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:19.840806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:19.841418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:19.841808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:19.842205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:19.842967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:19.858607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:19.859779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:19.860951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:19.862763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:19.863429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 295/591] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:19.864942 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:19.870578 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.952146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 297/592] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:19.969152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:19.982174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3c3d-4d3b-43c3-8301-fa29e610b764 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.017336 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.018010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.018290 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.018564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.019399 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:20.019708 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.021157 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.043724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 296/593] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:20.045301 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.075935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7313-2e57-469b-b9fa-3aace0ee65ad None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.111328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.112138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.112424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.112697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.130591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-74cd3451-7d97-4ca9-a04a-76b466e557fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:20.137761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:20.140279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 298/594] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:20.144380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf774f-b9cb-4e78-ab7d-623b85138ebe None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.145134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf774f-b9cb-4e78-ab7d-623b85138ebe None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.145134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf774f-b9cb-4e78-ab7d-623b85138ebe None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.145134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 299/595] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:20.146320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf774f-b9cb-4e78-ab7d-623b85138ebe None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.166108 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d55f6-f23c-40d2-b1ca-89b340bba293 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.203109 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.203876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.204247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.204529 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.252301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf774f-b9cb-4e78-ab7d-623b85138ebe None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.276691 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.278142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.285274 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.285939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.286215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.286483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.287216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:20.287690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.289515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eac4a-303c-4799-a836-882a472ab4cd None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.297404 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 300/596] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:20.298945 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6928-bc16-491b-bd57-07aa702ae55d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.299445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6928-bc16-491b-bd57-07aa702ae55d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.299931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6928-bc16-491b-bd57-07aa702ae55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.316314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-629b6928-bc16-491b-bd57-07aa702ae55d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:20.317968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-629b6928-bc16-491b-bd57-07aa702ae55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:20.385082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 297/597] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 07:03:20.386078 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.387977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 301/598] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:20.390097 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2cb66-8e18-4af7-bfe9-5826883a66fa None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.390315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2cb66-8e18-4af7-bfe9-5826883a66fa None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.390557 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2cb66-8e18-4af7-bfe9-5826883a66fa None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.395867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 302/599] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:20.396974 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2cb66-8e18-4af7-bfe9-5826883a66fa None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.485106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840803b-f6cb-45af-9b91-4fa15696913a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.496044 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2cb66-8e18-4af7-bfe9-5826883a66fa None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.518849 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.519634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.519913 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.520217 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.529314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.530087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.530363 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.530631 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.530789 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.532270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.540485 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.541928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-8116894e-4b51-43ed-b231-74fed67fbcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:20.550026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:20.550906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:20.551796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:20.551796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:20.551796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:20.551796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:20.551796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 298/600] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:20.552627 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.552908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.553184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:20.558926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:20.559947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 303/601] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:20.561007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.572661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:20.573846 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:20.637088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 299/602] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:20.637919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.658050 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781070a-2b59-4a13-8f63-bee4cb5314b9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.690960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.691748 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.692039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.692354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.702415 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:20.710031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:20.711612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 304/603] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:20.712690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.734686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19c13-be75-44d8-b50f-5a1653ee7023 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.769986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.770965 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.771392 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.771815 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.773543 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:20.774034 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.776220 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.789655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 300/604] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:20.790867 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.807862 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7e12-ab0d-4433-a849-c8e463e74d91 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.842205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.842856 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.843130 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.843400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.844113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:20.844444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.845789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.857727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 305/605] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:20.858502 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.893119 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470003c-8faf-47ff-be64-5565b7efda48 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.925054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.925838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.926115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.926388 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.935944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:20.943788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:20.945107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 301/606] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:20.946299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:20.951760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29dce3-5984-456b-a9cc-7a34049af677 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:20.984503 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:20.985163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:20.985456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:20.985733 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:20.986470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:20.986779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:20.988157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:20.995772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 306/607] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:20.996596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.042769 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8dd87-05f5-4068-bd54-59b212895137 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.074670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.075390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.075669 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.075943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.083395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.085021 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.094480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0109e0-1a38-428d-aaca-3e34474bad1d None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:21.104188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:21.105166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:21.106118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 302/608] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:21.106729 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.129564 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.130347 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.130690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.130904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.146375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.147830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:21.163056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:21.164662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:21.165539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 307/609] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:21.166023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.212709 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ce88-40d2-4d60-8600-a0b21317ae14 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.246184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.246882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.247165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.247440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.248216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.248528 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.249898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.258173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 303/610] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.259120 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.263446 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902395-c3b9-4752-9110-9ce8d64165b8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.296100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.296912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.297195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.297471 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.308067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.309529 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:21.326416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:21.327298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:21.328203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:21.328203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:21.328203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:21.328203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:21.328203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 308/611] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:21.328789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.362600 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646d47-7fdb-42bc-b0c5-54706059885a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.400292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.400966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.401253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.401531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.402406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.402715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.404162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.424652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0ac-69a6-4bd5-b0d3-9556570bef2c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.429566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 304/612] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.429566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.459143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.459813 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.460625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.460917 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.461702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.462008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.463429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.475397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 309/613] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.477058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.537767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5867d8-85da-4e58-9de3-eee196256c78 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.570539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.571329 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.571608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.571880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.577379 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d772-86e5-4b5e-953e-86219cdc6d79 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.581406 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.582834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:21.600737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:21.601886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:21.602776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:21.602776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:21.602776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:21.602776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:21.602776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 305/614] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:21.603183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.613524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.614181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.614470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.614748 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.615467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.615770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.617915 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.629297 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 310/615] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.630079 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.700694 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9387c5-496b-4709-8f14-a22c649faa5f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.725522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a7b0-479c-4383-b768-aeb3bbe58a6f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.733721 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.734365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.734644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.734920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.759490 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.760151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.760434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.760707 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.761522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=61fa2aa07d994d02867b8bafc7ff2644) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.761879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.763244 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.768818 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 311/616] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/role_assignments?user.id=61fa2aa07d994d02867b8bafc7ff2644&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.769585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.813193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.814673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.881064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875b3b-3a09-4a8f-9ff3-7b30886c57a8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:21.920065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:21.920762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:21.925610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:21.925795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 306/617] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:21.925877 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:21.925975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:21.926059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:21.926059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:21.926059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:21.937464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 312/618] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:21.938322 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.029206 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad0b3-88f6-4e1b-a662-efc72cd72cd1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.043760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cb024-a1fb-4ab6-ace6-b23ccfd5aea2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.063439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.064274 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.064555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.064826 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.072767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.074218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.078478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.079273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.079555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.079837 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:22.089196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:22.090164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:22.091110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 307/619] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:22.091726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.091802 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.093250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:22.111758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:22.112787 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 313/620] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:22.120226 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.190862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1e888-94ca-44fc-ae21-89baee5abf57 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.212086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c256-3f35-4d45-8701-da4a905ced51 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.225614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.226603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.226984 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.227331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.234423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.235880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.246095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.246758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.247088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.247364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.248220 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:22.248528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.249994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:22.251242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:22.252156 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 07:03:22.253113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:22.257728 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 308/621] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:22.258551 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.268105 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 314/622] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:22.268807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.364952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f55457-c7ed-4d97-af84-a19cc19d4b8c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.365311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2307f1-81ac-421f-b8a3-8d120259923d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.401436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.402107 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.402383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.402652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.403498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:22.403746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.403862 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.404451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.404735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.405010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.405227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.405731 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:22.406037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.407381 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.424317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 309/623] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:22.424317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.424584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 315/624] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:22.425989 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.524100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d642582-e358-4dd3-acc6-db71271ecca7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.529773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258383-70e0-4a35-8b9c-dd74d959b670 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.558427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.559076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.559359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.559636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.563374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.564189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.564480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.564759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.572096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.573573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:22.587180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:22.588067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:22.588983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 316/625] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:22.593712 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.629037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.630463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.692372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fe2a-fed0-468c-8039-1def2a89421c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.726610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.732005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 310/626] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:22.732170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.732170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.732170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.732433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.798036 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.799409 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.830749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a978e-0e22-465b-abae-bef7aa85e595 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.872734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:22.873533 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:22.873921 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:22.874300 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:22.875195 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:22.875609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:22.877166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:22.888989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 311/627] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:22.894371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 317/628] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:22.894520 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.895599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:22.991914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed18ba-a89e-4abd-b16e-2ba43f85bc44 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:22.995392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256973fc-a47a-4884-b7fc-b36393e46584 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.026306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.027103 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.027390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.027672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.029730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.030380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.030664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.030941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.031766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=3c9ac81291744cc1aca09035350296c6) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.032081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.033537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.038194 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.046294 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 318/629] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/role_assignments?user.id=3c9ac81291744cc1aca09035350296c6&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:23.046814 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.046898 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:23.065700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:23.066986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:23.067895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:23.067895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:23.067895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:23.067895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:23.070441 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 312/630] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:23.075646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.162640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec60f-caa7-4170-8ef6-dd152a605fc1 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.185841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33365a64-b2c5-4955-8e56-08eb0b2abea2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.201469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.202269 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.202556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.202932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.214631 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.216201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.225632 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.226934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.227475 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.227970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.228947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.229463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.231066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:23.235218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:23.236106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:23.237023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:23.237023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:23.237023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:23.237023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:23.237416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 319/631] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:23.242658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.249293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 313/632] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:23.254303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.344310 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0e58-a533-43b1-98a0-ee753f48d102 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.368145 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9b50-b1fc-42f3-9b58-3592ff486534 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.380587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.381931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.381931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.381931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.382612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.382925 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.384848 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.396206 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 320/633] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:23.404167 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.414762 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.415565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.415848 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.416142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.422987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.424482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:23.442092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:23.443166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:23.444218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:23.446665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 314/634] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:23.453102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.516467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acc20-38ca-4889-a115-daa35f6f74ab None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.560055 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.561442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.562242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.562711 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.572812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.575049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.575944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f39557-1052-4769-9d34-870e9e16d798 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:23.595127 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:23.596040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:23.596957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:23.600033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 321/635] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:23.605920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.617752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.618443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.619057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.619057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.619727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.620032 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.621751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.639209 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 315/636] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:23.640111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.741829 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c38bf-11fb-4dd2-83ae-22c7f15c7351 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.751376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef880-d983-40fe-806d-85caea10fb9c None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.785839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.786703 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.787196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.787545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.789404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=395edc9a3a5c4dc2b4dcc4f2a4d5e330) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.789521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.790084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.790957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.791124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.791567 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.792033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.793042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.793706 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.796072 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78fd5f-004a-403a-9cd3-f94cb2d86ebe None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.804874 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 316/637] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/role_assignments?user.id=395edc9a3a5c4dc2b4dcc4f2a4d5e330&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:23.810402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 322/638] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:23.816352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:23.934932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3b9-fe44-4455-9fb8-2922a09f37af None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:23.974297 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:23.975293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:23.975835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:23.977037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:23.978117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=015718a382044581ba4fceb50c466ea0) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:23.978617 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:23.980352 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a684-5621-40f5-9c3a-965a49397def None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:23.987610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 317/639] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:23 2022] GET /identity/v3/role_assignments?user.id=015718a382044581ba4fceb50c466ea0&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:24.204356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169de32-506d-4896-a0ae-fe3ee443f94b None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.205294 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169de32-506d-4896-a0ae-fe3ee443f94b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.205775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169de32-506d-4896-a0ae-fe3ee443f94b None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.207515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 323/640] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:24.213216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.214053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.214564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.233690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:24.235191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:24.307712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 318/641] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:24.332912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169de32-506d-4896-a0ae-fe3ee443f94b None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:24.447601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169de32-506d-4896-a0ae-fe3ee443f94b None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:24.484521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:24.485227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.485505 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.485775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.497350 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:24.505087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:24.506081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:24.507192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 324/642] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:24.514306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:24.619204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09174357-9ef3-4807-8614-36d67ef4a77c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:24.654658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:24.655335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.655616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.655892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.656693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:24.657276 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:24.658646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:24.668345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 319/643] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:24.673835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:24.775529 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2c78-6003-4a4e-9f07-dfb1376b5ea3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:24.809086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:24.809879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.810163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.810442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.822402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:24.823870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:24.841897 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:24.842840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:24.843749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:24.843749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:24.843749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:24.843749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:24.843749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 325/644] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:24.850430 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:24.951742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f732a-7bb5-4009-9cdb-62a66ba744d2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:24.986403 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:24.987457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:24.987944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:24.988442 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:24.989385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:24.989910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:24.991543 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.005237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 320/645] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:25.013281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.116907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe320cca-b194-4505-8006-32a5c4b56ed3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:25.152577 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:25.153432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.153713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.154045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.162623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:25.165456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:25.180498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:25.181497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:25.182434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 326/646] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:25.189050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.291290 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e793-e4d1-42af-8d72-df787a32a2a2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:25.325528 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:25.326616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.327121 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.327599 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.328681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:25.329213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:25.330850 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44f50-316a-4750-87e4-6cf89eeb7911 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.349533 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 321/647] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:25.356161 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.466247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2127fee-2bbd-4570-ac90-8e50157a67c9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:25.499977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:25.500659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.500941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.501217 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035bb5-24ce-41c5-9ecc-461abb802bd1 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.559187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035bb5-24ce-41c5-9ecc-461abb802bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.559399 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035bb5-24ce-41c5-9ecc-461abb802bd1 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.561350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 322/648] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:25.568405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.568948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.569951 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.573554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:25.575112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.587367 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:25.588950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:25.672670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 323/649] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:25.695673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.698327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 327/650] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 07:03:25.704400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.819213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bde0d-b112-43d1-b7d9-7f53847d2862 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:25.822769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec1bc-5ed7-4115-8757-c04e75a11b0c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:25.859442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:25.860650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.861129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.861607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.864231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:25.865322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:25.865609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:25.865887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] PATH_INFO: `/v3/services/image` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:25.867149 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:25.868620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.873758 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:25.875425 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:25.885200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:25.886344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:25.892613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 324/651] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:25.894977 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:25.898820 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:25.899857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:25.901535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:25.901535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:25.901535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:25.901535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:25.904400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 328/652] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:25.908340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.005240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bec31-e8c5-463f-99df-4bc0f57a8186 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.012162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40b729-38ff-4e0e-af17-d4e641ff20bf None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.044650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.045742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.046234 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.046717 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.047749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] RBAC: Adding query filter params (name=image) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.048311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.050141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.050647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.051427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.051811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.052220 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.053049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.053457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.055680 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.061775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 325/653] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:26.063377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.068899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 329/654] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:26.074767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.168005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42e7f6-fa14-434c-a93a-f54e560a1787 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.178170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e196-9515-4eb1-8a70-758f7fbe3f2a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.203136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.204185 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.204678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.205162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.206092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] RBAC: Adding query filter params (type=image) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.206622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.208230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a22b34-6de3-4f1c-a120-dc89ff9ee0be None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.213491 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.214290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.214575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.214851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.217004 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 326/655] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:26.218566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd099-c6d5-415e-afe3-52603b5603c6 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.219067 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd099-c6d5-415e-afe3-52603b5603c6 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.219606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd099-c6d5-415e-afe3-52603b5603c6 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.221531 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 327/656] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:26.225432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.228016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.228205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.228404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.228653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.247224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:26.247827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:26.248743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:26.249668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:26.250099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:26.253168 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 330/657] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:26.259698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.352608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 328/658] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:26.369991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.376070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0adab-ff36-43bd-b818-b28d58b6c550 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.425263 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.426744 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.427083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.428393 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.429374 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.429691 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.431843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.450099 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 331/659] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:26.456591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.488246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e4bd-32d2-4706-ba66-ebad8aaa1f4f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.527680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.528892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.529382 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.529863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.530722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.532337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b364b90a-09b3-43e5-8374-d98c2c505d57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:26.545845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:26.546817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:26.547686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:26.552198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 329/660] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:26.554460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f320-6a3f-4c43-af61-97a056358949 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.554866 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f320-6a3f-4c43-af61-97a056358949 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.555191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f320-6a3f-4c43-af61-97a056358949 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.556988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 330/661] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:26.560167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f320-6a3f-4c43-af61-97a056358949 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.566488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d035f4-bac0-4565-9f37-ec6e7ec200d1 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.604205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.604978 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.605261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.605537 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.606964 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=61fa2aa07d994d02867b8bafc7ff2644) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.607285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.609140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afaf61-a75c-4203-b932-dc285f0e553a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.624354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 332/662] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/role_assignments?user.id=61fa2aa07d994d02867b8bafc7ff2644&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:26.626224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.626535 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.626818 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.650403 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:26.651618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:26.668834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f320-6a3f-4c43-af61-97a056358949 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.708540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.709767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.710826 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.711365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.712388 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.712995 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.714680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.720145 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 331/663] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:26.726330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.745108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 333/664] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:26.773944 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:26.860181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c4656-04f4-4e7d-81b7-e51431278074 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.892715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fb6cd-91c0-4262-a1f6-ee8fe8151ba2 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:26.904574 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.905641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.905932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.906213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.907270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:26.907587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.909304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.920159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 332/665] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:26.933978 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:26.934865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:26.935154 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:26.935476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] PATH_INFO: `/v3/services/network` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:26.936165 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:26.937583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:26.953352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:26.954410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:26.955240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 334/666] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:26.962732 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:27.089568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb2c4-ea3c-499b-af8f-3ac1c901f202 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:27.126335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:27.127373 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:27.127854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:27.128361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:27.129270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] RBAC: Adding query filter params (name=network) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:27.129774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:27.131347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78505e-8942-45de-882d-0696174ae310 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:27.137370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 333/667] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:27.142632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:27.250896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ae0d-f7ee-4068-83b6-d950badc1b0c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:27.284613 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:27.285411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:27.285790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:27.286162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:27.286960 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] RBAC: Adding query filter params (type=network) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:27.287361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:27.288872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fca4e2-9fa1-4b7b-b314-fc412640be1b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:27.294872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 335/668] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:28.639480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595d9-03c0-451a-945b-04753c0ef5e0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:28.640020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595d9-03c0-451a-945b-04753c0ef5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:28.640020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595d9-03c0-451a-945b-04753c0ef5e0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:28.641666 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 334/669] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:28.646940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb28-0332-4004-a351-e889b3569e4b None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:28.647421 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb28-0332-4004-a351-e889b3569e4b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:28.647612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb28-0332-4004-a351-e889b3569e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:28.665618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-3794eb28-0332-4004-a351-e889b3569e4b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:28.666784 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-3794eb28-0332-4004-a351-e889b3569e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:28.736757 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 336/670] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:28.760793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c595d9-03c0-451a-945b-04753c0ef5e0 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:28.869455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c595d9-03c0-451a-945b-04753c0ef5e0 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:28.905494 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:28.906521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:28.907024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:28.907500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:28.908488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:28.910065 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cab65-888a-4162-b055-7ca89a30ac49 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:28.928885 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 335/671] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:28 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:29.003323 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a8c7-d072-4fd1-8f8e-74243012dac6 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.003625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a8c7-d072-4fd1-8f8e-74243012dac6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.003809 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a8c7-d072-4fd1-8f8e-74243012dac6 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.005466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 337/672] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:29.016671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.016982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.017242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.036326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:29.038485 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:29.135012 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 336/673] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 07:03:29.158662 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a8c7-d072-4fd1-8f8e-74243012dac6 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.277509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a8c7-d072-4fd1-8f8e-74243012dac6 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:29.312267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:29.313437 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.313927 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.314416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.326239 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-5d9db5d6-3ba8-4f7b-ba31-32a9c5bac8b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:29.334429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:29.335524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:29.336476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:29.339201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 338/674] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:29.344752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.396859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d56-a889-4d30-9375-c167b93623eb None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.397199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d56-a889-4d30-9375-c167b93623eb None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.397644 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d56-a889-4d30-9375-c167b93623eb None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.403569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 339/675] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:29.405241 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.405531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.405817 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.426472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:29.428412 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:29.452542 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832931-3704-4154-af36-89d4fe8f2a78 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:29.488455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:29.488917 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.489201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.489481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.490257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:29.490567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:29.492801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:29.504796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 337/676] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:29.510689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.528745 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 340/677] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:29.552961 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.639257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6249-a423-46e4-a63f-a851cc81d05a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:29.660836 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f135-e3fe-476d-bc4a-8d26cbc80df5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:29.683776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:29.684742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.685194 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.685483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.696335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:29.697130 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.697474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.697817 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.698640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:29.699188 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:29.700031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a6f4-e4c1-4930-bb81-e21fbc135cb3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:29.700674 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:29.714728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 341/678] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:29 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:03:29.715997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91ba-5d47-4804-81fb-a1f395e29dda None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.716314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91ba-5d47-4804-81fb-a1f395e29dda None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.716592 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91ba-5d47-4804-81fb-a1f395e29dda None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.717813 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 342/679] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:29.723761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.724041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.724354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:29.724741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:29.726641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:29.727988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:29.727988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:29.727988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:29.727988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:29.732054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 338/680] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:29.733410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.748791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:29.750303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:29.836271 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 343/681] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:29 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 07:03:29.845595 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd161-fcb7-48b2-8cbc-2bd9bd621ec9 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:29.856203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.884304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:29.884989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:29.885291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:29.885553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:29.886295 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:29.886603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:29.888024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:29.906705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 339/682] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:29.908082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:29.965759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77d79-fda8-4230-af4b-dcc9814c3dcf None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.005438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.006446 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.007385 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.007681 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.009472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.009827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.025162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 344/683] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:29 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:03:30.037135 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71c-1216-4f38-9c1c-2be3e5a21b94 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.085523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.086642 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.086873 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.087207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.095974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.097873 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:30.114770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:30.115786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:30.116861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 340/684] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:30.122286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:30.238948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae27d2d-6cf5-4018-b5a9-1b36c0648b1c None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.274213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.275299 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.275793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.276302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.277338 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:30.277896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.279539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.298264 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 345/685] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:30.303696 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:30.418548 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efbc0-9481-4dce-9de6-ea5adfbebed2 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.454974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.455912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.456320 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.456696 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.467733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.469333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:30.487862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:30.488969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:30.490050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:30.490050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:30.490050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:30.490050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:30.492776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 341/686] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:30.501221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:30.610878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1f9e-832c-4710-9b60-cf613700b7cc None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.656035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.656736 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.657023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.657302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.658227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:30.658692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.660867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.681382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 346/687] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:30.683655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:30.785751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c1805-b004-4440-8b88-4a140bbf6413 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.820586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.821392 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.821676 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.821958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.828943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:30.830401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:30.844416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:30.846232 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:30.848328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:30.851174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 342/688] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:30.852595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:30.959166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bd50-5909-471b-b075-448796c317c2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:30.996451 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:30.997134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:30.997469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:30.997804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:30.998614 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:30.998980 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:31.000459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490c04-8b2b-4072-bd32-6b72c10f4754 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:31.020276 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 347/689] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:31.022669 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:31.128334 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2fd8d-a219-4214-948d-57d953b4ecd3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:31.162518 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:31.163647 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:31.163935 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:31.164250 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/61fa2aa07d994d02867b8bafc7ff2644/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:31.166248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=61fa2aa07d994d02867b8bafc7ff2644, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:31.167777 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7701-9ffc-465b-af91-f54cb24cbe5b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:31.187825 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 343/690] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:03:31 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/61fa2aa07d994d02867b8bafc7ff2644/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:03:31.465987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b825c3-20d1-46ec-9aee-8a4198068fcc None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:31.466280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b825c3-20d1-46ec-9aee-8a4198068fcc None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:31.466570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b825c3-20d1-46ec-9aee-8a4198068fcc None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:31.468212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 348/691] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:31.473770 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:31.474064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:31.474349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:31.491000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:31.492341 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:31.564210 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 344/692] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:31.588375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b825c3-20d1-46ec-9aee-8a4198068fcc None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:31.692248 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b825c3-20d1-46ec-9aee-8a4198068fcc None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:31.728428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:31.729224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:31.729515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:31.729794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:31.730448 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:31.731818 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:31.743883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:31.746146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:31.748039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 349/693] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 12 07:03:31 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:31.757975 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:31.856351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37083f2-6ec2-44dd-8631-b3d2e0087fe2 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:31.891111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:31.891782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:31.892066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:31.892378 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:31.893164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] RBAC: Adding query filter params (name=image) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:31.893475 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:31.894843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:31.900471 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 345/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:31.906002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.020541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03493f2-3af9-4697-a4e3-1bf8536b8bf2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.059424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.060110 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.060422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.060699 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.061422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] RBAC: Adding query filter params (type=image) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:32.061729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.063136 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.069737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 350/695] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:32.075920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.176327 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045840-48fb-4b7e-82ae-73f01d683772 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.211658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.212354 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.212639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.212918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.213712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] RBAC: Adding query filter params (interface=public, service_id=971e188c22e943d3bbd6ccb1caf00790, region_id=RegionOne) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:32.214026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.215453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed854bf4-909b-4003-8535-eba84f902094 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.223743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 346/696] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/endpoints?service_id=971e188c22e943d3bbd6ccb1caf00790&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:32.229694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.240270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e45fb5-a04e-4119-b5c8-91a6e2f49bbc None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.240270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e45fb5-a04e-4119-b5c8-91a6e2f49bbc None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.240270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e45fb5-a04e-4119-b5c8-91a6e2f49bbc None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.240270 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 347/697] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:32.247718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.247718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.247718 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.265353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:32.267366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:32.336987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6002-d00e-440c-b8e3-4c8b98089c25 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.356338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 348/698] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:32.380260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.382686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.383658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.384100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.384425 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.385233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.386677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.392610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 351/699] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services => generated 1002 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:03:32.499527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e663424-8e89-4a04-bf58-d1d0773b889e None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.541920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.542768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.543052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.543331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.544002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.545468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-affdf9da-995f-485c-902a-da3fb2419a95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:32.558838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:32.559858 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.560733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 349/700] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:32.567492 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.658526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb561cb-e95c-4a75-9d16-4440fed89254 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.658888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb561cb-e95c-4a75-9d16-4440fed89254 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.659080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb561cb-e95c-4a75-9d16-4440fed89254 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.661824 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 350/701] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:32.666167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.666458 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.666742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.672169 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cd63-1ca9-47e1-ad04-d67cc7b00cf6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.684087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:32.685293 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:32.706038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.706683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.706966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.707238 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.707934 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:32.708314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.710257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.715175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 352/702] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:32.720741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.760236 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 351/703] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:32.778415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.821253 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3ee7-3de0-4144-8bf0-9f06aecfa855 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.855061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.855729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.856009 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.856361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.857060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:32.857363 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.858712 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.863895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 353/704] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:32.870191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.881013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573cbb2-96fb-4f0c-9321-d0784f3dc09a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:32.917130 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:32.917865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:32.918141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:32.918417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] PATH_INFO: `/v3/services/network` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:32.919074 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:32.920489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:32.933038 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:32.935315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:32.937308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:32.940164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 352/705] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:32.942223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:32.971548 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e034458-75af-48b2-8791-92417fc27abf None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.006011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.007281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.007536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.007872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.008746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] RBAC: Adding query filter params (interface=public, service_id=48ba4808050343f1a2724b8564f2bea8, region_id=RegionOne) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:33.009064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.010430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.024489 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 354/706] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/endpoints?service_id=48ba4808050343f1a2724b8564f2bea8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:33.027560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:33.071756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a424bb-adc3-47dc-a9a2-2a703df07d12 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.115567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.116606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.117556 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.117989 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.119151 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] RBAC: Adding query filter params (name=network) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:33.119784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.121962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.129257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f40e-3dfd-4e68-aa29-dea69f7dece2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.133840 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 353/707] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:33.135465 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:33.167624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.168213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.168464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.168754 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.169414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.170797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.184309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 355/708] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/services => generated 1002 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:03:33.256879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a55eb-1824-40df-9140-6818c0fce21a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.295390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.296488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.296997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.297475 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.298409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] RBAC: Adding query filter params (type=network) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:33.298918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.300620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.312428 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 354/709] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:33.317385 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:33.424340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5975f6-1e32-4bbc-9d89-07f92e23aa49 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.463214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.463869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.464166 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.464445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.465234 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] RBAC: Adding query filter params (interface=public, service_id=9d7aaf6c15324885a6d1f0cda399dca2, region_id=RegionOne) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:33.465543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.466911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006301a-3ef9-4b45-a60a-0f6f3dfa5b90 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.472793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 356/710] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/endpoints?service_id=9d7aaf6c15324885a6d1f0cda399dca2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:33.478197 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:33.581490 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d339d1-9f37-4e62-9f91-a63ece4abb7f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.618787 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.619480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.619812 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.620100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.620819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:33.622871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:33.633665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b9c5-eb31-4cba-8d21-d9637b6d64b4 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.633969 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b9c5-eb31-4cba-8d21-d9637b6d64b4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.634211 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b9c5-eb31-4cba-8d21-d9637b6d64b4 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.635910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 357/712] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:33.636098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 355/712] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/services => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:03:33.641750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.642089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.642301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.662246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:33.664345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:33.739976 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 358/713] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:33.766175 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:33.873661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a4464-18c3-4b5c-9f94-8d4fc8a8d491 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:33.907504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:33.908330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:33.908612 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:33.908886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:33.920196 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:03:33.927891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:33.930749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:33.932887 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 356/714] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:33.938273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.043995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d646fc-3779-4414-af9a-045468ae94dd None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.079675 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.080376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.080658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.080935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.081690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:34.081998 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:34.083365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:34.093180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 359/715] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:34.099179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.201730 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e14b-7965-45b0-95fb-de06f7440dac None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.235361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.236190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.236478 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.236756 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.248785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:34.250240 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:34.267133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:34.269092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:34.270182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:34.270182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:34.270182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:34.270182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:34.270182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 357/716] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:34.275195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.388877 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4917-17bd-4a00-bc49-5343f116397f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.426058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.426770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.427051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.427383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.428110 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:34.429112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:34.430629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:34.446199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 360/717] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:34.450716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.556925 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb9df5-c13d-4204-8dcc-98191b6b40a8 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.592227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.593020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.593302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.593583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.603175 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:34.604668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:34.619246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:34.621426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:34.623654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 358/718] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 12 07:03:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:34.628021 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.745181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfa4a9-3ca5-4a1a-a28f-33c549dcd93b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.781026 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.781695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.781980 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.782252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.783089 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:34.783396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:34.784859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626c505-8c1a-411b-a605-09dea960c09d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:34.802923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 361/719] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 12 07:03:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:34.809139 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:34.889427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c23c9-7ef2-4491-9d68-c3634a967977 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.897866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c23c9-7ef2-4491-9d68-c3634a967977 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.897866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c23c9-7ef2-4491-9d68-c3634a967977 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.897866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 362/720] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:34.898400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.898400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.898732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.915768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:34.916931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:34.921193 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d4df-8d88-40e4-8109-6d88a16eabe3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:34.957781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:34.958442 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:34.958726 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:34.959002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:34.994439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 363/721] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:35.018274 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.047558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.049566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.143138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455e7f0-1d08-4cea-aa70-97cefda41f97 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.173856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 359/722] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:34 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 07:03:35.174759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.190647 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.191946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.192867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.193380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] PATH_INFO: `/v3/services/image` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.194542 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.196673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:35.213251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:35.214302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 07:03:35.215132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:35.218608 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 364/723] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:35.225638 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.282509 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb9863-62ce-4958-b7d1-0cbd4207472e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.317544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.318746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.319781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.320344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.331452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.333539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.349146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0a10-296e-4e54-9532-609c177618aa None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:35.353914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:35.354805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:35.355720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:35.355720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:35.355720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:35.355720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:35.357960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 360/724] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:35.364773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.396006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.397918 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.398867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.399701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.400924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] RBAC: Adding query filter params (name=image) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:35.401966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.404233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.411814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 365/725] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:35.418135 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.501245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128ea3-481c-4f72-af1c-5402ff8f70c7 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.542276 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.543771 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.544587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.545080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.546042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:35.546225 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98879-5814-4ed5-b1d1-a54e993a3cbd None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.546727 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.549452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.564683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 361/726] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:35.571997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.593707 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.594369 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.594649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.594924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.595624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] RBAC: Adding query filter params (type=image) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:35.595930 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.597335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2a68-751d-4b51-bb0c-d7513e59a963 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.603196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 366/727] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:35.604315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ed34-cba8-48ed-b415-2db35647cfde None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.604603 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ed34-cba8-48ed-b415-2db35647cfde None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.604880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ed34-cba8-48ed-b415-2db35647cfde None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.606213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 367/728] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:35.608626 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ed34-cba8-48ed-b415-2db35647cfde None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.686914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc3b6f-6828-4722-adc9-b01f04e333ea None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.710715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ed34-cba8-48ed-b415-2db35647cfde None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.721590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.722380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.722919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.723204 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.730166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.731547 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.744281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.744940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.745225 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.745769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.746230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b933b96a-ebe4-4397-8be6-c9be87096bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:35.746513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:35.747390 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:35.748318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:35.748736 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.752528 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 362/729] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:35.753830 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.754100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.754382 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.770200 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 368/730] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:03:35.772987 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:35.774221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:35.781750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.862045 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 363/731] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:35 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:35.888912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:35.908727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428f30-1fc8-4027-a666-fb0858ba6352 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:35.948447 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:35.949749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:35.950252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:35.950726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:35.951804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:35.952341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:35.954082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:35.968924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 369/732] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:35.979013 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.003326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a5364-c692-409d-9f32-0ae5258f74f6 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.060784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.061592 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.061871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.062142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.062801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.064395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-93249a8f-52a4-45e5-8a60-13b67be0d037 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:36.076766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:36.077772 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.078616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 364/733] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:36.079468 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fe210-aaf2-4b08-9fe9-30330f21499d None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.079789 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fe210-aaf2-4b08-9fe9-30330f21499d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.080000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fe210-aaf2-4b08-9fe9-30330f21499d None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.081899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 365/734] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:36.086315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fe210-aaf2-4b08-9fe9-30330f21499d None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.107383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabf9a6-0729-46ed-8617-ac90edcedeef None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.141230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.141873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.142154 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.142429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.143254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=61fa2aa07d994d02867b8bafc7ff2644) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:36.143559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.145046 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e1ead-4992-4f87-99fa-b5bf3a300fda None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.160151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 370/735] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:03:35 2022] GET /identity/v3/role_assignments?user.id=61fa2aa07d994d02867b8bafc7ff2644&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:36.160151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.160151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.160151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.170701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:36.171907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:36.212081 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fe210-aaf2-4b08-9fe9-30330f21499d None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.255940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 371/736] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:36.258317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.259015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.259306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.259584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.260768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:36.261080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.262480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.268220 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 366/737] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:36.277812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.279088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.393330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc2b9-2757-45ea-9a0e-31490b1a0e28 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.416601 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bbb6-cd74-4cdf-93f0-fb7de73f1254 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.447950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.449591 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.449994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.450461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] PATH_INFO: `/v3/services/network` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.451497 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.453817 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.467086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.468212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.468711 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.469198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.470441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:36.471314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.473780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:36.480954 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:36.482247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 07:03:36.483360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:36.484094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 372/738] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 12 07:03:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:36.489502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 367/739] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:36 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:36.495833 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.497052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.608733 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67874b-4943-4337-b2cc-5527acc38e7d None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.611580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fddad2-3865-4c1c-b5c0-bc78f5fa50cc None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.643890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.644522 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.644807 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.645645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.646361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] RBAC: Adding query filter params (name=network) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:36.646671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.648289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.652749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.653685 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.653797 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 368/740] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:36.654285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.654567 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.655319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.658008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.658963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.680336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 373/741] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:36.782555 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132eb08-4d39-4d9a-8f96-9c09bd052790 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.827995 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.828781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.829070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.829349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.830079 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] RBAC: Adding query filter params (type=network) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:36.830388 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.831796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce3e71-1e88-4126-a7be-ecb5f244396a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:36.838955 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 369/742] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:36.844884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:36.952160 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3250cc-e9c9-40a2-a795-91f2c686a227 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:36.987260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:36.987923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:36.988237 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:36.988518 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:36.989276 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:36.990685 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f28d-56b8-41a3-bad6-43e1116bfb38 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:37.011315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 374/743] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:38.297412 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29d86-9722-4b2e-98c7-4416b5d1ff42 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.297981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29d86-9722-4b2e-98c7-4416b5d1ff42 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.297981 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29d86-9722-4b2e-98c7-4416b5d1ff42 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.299305 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 370/744] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:38.305128 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fd7b-88b9-4be0-8ead-dd2cefa3eb60 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.305560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fd7b-88b9-4be0-8ead-dd2cefa3eb60 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.305701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fd7b-88b9-4be0-8ead-dd2cefa3eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.322741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-f675fd7b-88b9-4be0-8ead-dd2cefa3eb60 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:38.323919 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-f675fd7b-88b9-4be0-8ead-dd2cefa3eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:38.396163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 375/745] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:38.417049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a29d86-9722-4b2e-98c7-4416b5d1ff42 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:38.526735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a29d86-9722-4b2e-98c7-4416b5d1ff42 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:38.559280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:38.559850 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.560148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.560430 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.624790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:38.626241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:38.676998 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f495-0dec-4989-8889-a7177073ac28 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.677347 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f495-0dec-4989-8889-a7177073ac28 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.677554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f495-0dec-4989-8889-a7177073ac28 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.679603 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 376/746] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:38.684624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.684904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.685189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.701970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:38.703152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:38.722010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 371/747] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:03:38 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 07:03:38.727793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:38.771203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 377/748] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:38.794565 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:38.824713 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453a167-b182-4ace-ac13-8864458e62c6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:38.858168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c557804-5327-4217-80cb-90324df3493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:38.858970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c557804-5327-4217-80cb-90324df3493b None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.859254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c557804-5327-4217-80cb-90324df3493b None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.859532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c557804-5327-4217-80cb-90324df3493b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.869467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c557804-5327-4217-80cb-90324df3493b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:38.870919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c557804-5327-4217-80cb-90324df3493b None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-3c557804-5327-4217-80cb-90324df3493b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:03:38.889637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:38.890645 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:38.891527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:03:38.891527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:03:38.891527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:03:38.891527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:38.891527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 372/749] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:38.895522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c2ca-9908-44d4-a7aa-cfa219b754c6 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:38.897940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c557804-5327-4217-80cb-90324df3493b None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:38.931471 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:38.932319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:38.932633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:38.932912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:38.933555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:38.934939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:38.947651 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:38.953887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:38.954800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 378/750] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 12 07:03:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:38.955634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:38.997916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c557804-5327-4217-80cb-90324df3493b None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.033788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.034489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.034994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.035285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.036071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:39.036395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.037881 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccfe8c-dc93-4550-bba1-58c10b1722f2 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.060167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 373/751] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:39.076347 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f19a-a655-4225-9969-484044eb1b6f None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.087211 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1dfb-3fd2-4e64-895c-2059095e5402 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.087500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1dfb-3fd2-4e64-895c-2059095e5402 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.087788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1dfb-3fd2-4e64-895c-2059095e5402 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.089319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 374/752] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:39.095147 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.095440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.095735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.113964 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.114646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.114928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.115144 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:39.115268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.115935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:39.116303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.116759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:39.117901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.126320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 379/753] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:39.132632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:39.243469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840dd8-7f63-4806-9b7a-87634e23a958 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.282800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.283475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.283756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.284033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.284870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:39.285180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.286548 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.292737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 380/754] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:39.315884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 375/755] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:39.340795 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:39.450804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa872-1f54-44cc-b8f3-a63188202cb4 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.485825 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.486625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.486913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.487189 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.487839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.489251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:39.502175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:39.503278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:39.504399 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 381/756] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:39.510326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:39.605347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcd9ae-ca06-4972-8463-f1bdcb1ccbd4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.637161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.637822 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.638104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.638380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.639081 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:39.639387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.640782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cbc3c-06c6-437d-90c8-d59ef565cb73 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.645144 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 376/757] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:39.651010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:39.747472 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24032-1433-4cb5-a646-30662eac6e7d None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:39.779298 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:39.779952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:39.780268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:39.780550 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:39.781251 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:39.781559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:39.782920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642144-6403-4f15-956a-0f992b80af6a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:39.787205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 382/758] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:41.598489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cccfa-25a7-4371-bd54-fba4432a6ea0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:41.599013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cccfa-25a7-4371-bd54-fba4432a6ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:41.599101 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cccfa-25a7-4371-bd54-fba4432a6ea0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:41.600537 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 377/759] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:41.605745 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a460-6773-4d47-9656-7583f0a892e6 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:41.606140 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a460-6773-4d47-9656-7583f0a892e6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:41.606348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a460-6773-4d47-9656-7583f0a892e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:41.623035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4bd6a460-6773-4d47-9656-7583f0a892e6 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:41.624228 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4bd6a460-6773-4d47-9656-7583f0a892e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:41.688952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 383/760] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:41.713902 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cccfa-25a7-4371-bd54-fba4432a6ea0 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:41.810216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cccfa-25a7-4371-bd54-fba4432a6ea0 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:41.843115 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:41.843782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:41.844066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:41.844375 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:41.845101 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:41.846466 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c746-3611-4bae-a9e1-ab0ee6cb7056 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:41.859107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 378/761] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:41 2022] POST /identity/v3/services => generated 269 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:42.129629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363821c4-b464-4095-a6b1-728dda3b981c None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:42.129895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363821c4-b464-4095-a6b1-728dda3b981c None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:42.130120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363821c4-b464-4095-a6b1-728dda3b981c None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:42.132772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 384/762] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:42.138209 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e877-2a1e-4fce-9ae3-84e379cfcbe1 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:42.138565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e877-2a1e-4fce-9ae3-84e379cfcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:42.138911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e877-2a1e-4fce-9ae3-84e379cfcbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:42.155076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-1d40e877-2a1e-4fce-9ae3-84e379cfcbe1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:42.156265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-1d40e877-2a1e-4fce-9ae3-84e379cfcbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:42.225649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 379/763] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:42 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:42.249351 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363821c4-b464-4095-a6b1-728dda3b981c None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:42.470342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363821c4-b464-4095-a6b1-728dda3b981c None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:42.503161 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:42.503814 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:42.504091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:42.504402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:42.505107 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:42.506780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a660d5a-2db4-4b03-ad4c-8e9e6b695735 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:42.532162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 385/764] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:42 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:44.212167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90462175-fd79-4c3c-8196-f1ac9e74e97a None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.212697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90462175-fd79-4c3c-8196-f1ac9e74e97a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.212785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90462175-fd79-4c3c-8196-f1ac9e74e97a None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.214093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 380/765] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:44.219446 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.219836 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.220058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.237281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:44.238438 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:44.306015 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 386/766] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:44.330265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90462175-fd79-4c3c-8196-f1ac9e74e97a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:44.429462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90462175-fd79-4c3c-8196-f1ac9e74e97a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:44.462566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:44.463306 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.463587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.463860 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.464618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:44.465980 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:44.478948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:44.479960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:44.480844 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 381/767] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:44.486099 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:44.581129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5fab-61e7-41a6-8fab-77cd2759de58 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:44.615007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:44.616355 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.616638 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.616909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.617612 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:44.617916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:44.619274 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:44.623821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 387/768] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:44.629597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:44.729838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bea46d-7ccc-40f9-90be-457620b56aaa None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:44.761846 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:44.762508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.762792 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.763068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.763833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:44.764167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:44.765629 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddc2b5-6a5b-4419-989a-ec770324b529 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:44.770330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 382/769] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:44.776291 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:44.866341 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657775-46e9-4c02-8713-4d5819fbf6d8 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.866621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657775-46e9-4c02-8713-4d5819fbf6d8 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.866897 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657775-46e9-4c02-8713-4d5819fbf6d8 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.868292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 383/770] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:44.872875 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5311dab-8812-410c-9f26-7da08f53e515 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:44.873369 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.873653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.873934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.890908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:44.892089 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:44.906380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:44.907024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:44.907300 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:44.907572 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:44.908376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] RBAC: Adding query filter params (interface=public, service_id=d8f58186a8c940e7940dfa80d8df725b, region_id=RegionOne) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:44.908683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:44.910029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:44.915829 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 388/771] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/endpoints?service_id=d8f58186a8c940e7940dfa80d8df725b&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:44.921276 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:44.956959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 384/772] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:44.981573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:45.015520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baa10-6724-48ce-8e95-96f125c6eaa9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.047841 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.048531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.048815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.049093 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.049766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.051126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.056881 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 389/773] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/services => generated 1498 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:03:45.079060 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb35158-6da7-430a-8f34-42a9dbe38e04 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.115670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.116604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.116884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.117152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.117816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.119216 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:45.131926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:45.133085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:45.133916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 385/774] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:45.139648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:45.242341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f20-d07f-4c34-9fa6-b385ce18f00a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.278156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.278810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.279088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.279358 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.280050 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:45.280382 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.281765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.286302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 390/775] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:45.292377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:45.391319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c39b1d-1791-494e-b29b-313f37dda26e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.424349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.425012 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.425290 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.425565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.426269 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:45.426571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.428526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.433550 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 386/776] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:45.439788 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:45.535609 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb4d3-565e-4538-bc73-0898fc22c060 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.568058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.568766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.569163 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.569453 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.570233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] RBAC: Adding query filter params (interface=public, service_id=05df709ad5ac4dae92c42144ade738dd, region_id=RegionOne) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:45.570538 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.571884 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab51c-6c8a-444f-a1d8-87afc4f53de8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.576938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 391/777] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:45 2022] GET /identity/v3/endpoints?service_id=05df709ad5ac4dae92c42144ade738dd&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:45.582757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:45.679044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e7ba7-d6e1-4ffd-9727-ac067c77ca8f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:45.710331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:45.710982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:45.711267 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:45.711546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:45.712260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:45.713617 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7364d2-f1db-4851-b3a5-f49bef574de5 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:45.719350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 387/778] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:45 2022] GET /identity/v3/services => generated 1498 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:03:47.357801 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac86e2e-253e-4b1b-a3a7-87d3681cfc3b None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:47.358431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac86e2e-253e-4b1b-a3a7-87d3681cfc3b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:47.358431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac86e2e-253e-4b1b-a3a7-87d3681cfc3b None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:47.359720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 392/779] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:47.365713 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:47.366168 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:47.366479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:47.383265 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:47.384479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:47.454757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 388/780] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:47.478642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac86e2e-253e-4b1b-a3a7-87d3681cfc3b None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:47.575677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac86e2e-253e-4b1b-a3a7-87d3681cfc3b None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:47.608506 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:47.609228 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:47.609508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:47.609780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:47.610423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:47.611782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:47.624654 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:47.625762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:47.626679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 393/781] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 12 07:03:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:47.632618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:47.727793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966402-ad3c-4754-97bf-029d5a0fd267 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:47.760252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:47.760920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:47.761205 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:47.761481 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:47.762190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:47.762496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:47.763859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:47.768417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 389/782] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:47.774646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:47.874297 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce74f-4b44-4681-a373-372a5d6a7306 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:47.906227 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:47.906883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:47.907165 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:47.907444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:47.908168 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:47.908481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:47.909843 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76855115-47eb-4fe1-ac02-8acc18303c7c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:47.915149 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 394/783] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 12 07:03:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:47.921018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:48.017285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6343ae8-59d7-4045-a7bb-f8e2f093ce87 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:48.038371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b3d9-92a3-4920-b9fa-3ee9f9c10116 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.038696 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b3d9-92a3-4920-b9fa-3ee9f9c10116 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.038936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b3d9-92a3-4920-b9fa-3ee9f9c10116 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.040313 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 395/784] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:03:48.045400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.045759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.046113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.051443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:48.052105 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.052415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.052690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.053439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:48.054799 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:48.062500 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:48.063687 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:48.074630 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 390/785] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:48.145622 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 396/786] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:48.171088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:48.277796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f89d-809a-4449-b975-cc9727c06827 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:48.310317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:48.311125 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.311407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.311684 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.312366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:48.313738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:48.325506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:48.326640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:48.327484 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 391/787] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:48.333457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:48.429096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2707-c7f5-45bc-b722-eb09937074bb None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:48.462519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:48.463181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.463462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.463736 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.464483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:48.464788 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:48.466142 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:48.470833 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 397/788] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:48.477681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:48.572355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa4bb1-37d6-4c4c-a3e8-2eff3244f961 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:48.605018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:48.605682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.605963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.606236 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.606936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:48.607237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:48.608634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807931d-a559-49cb-b735-9a0c010323d4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:48.613328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 392/789] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 12 07:03:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:48.619575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:48.713850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7548-2dd6-4e22-b2c9-87908a6f7594 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:48.747229 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:48.747876 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:48.748186 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:48.748464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:48.749190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:48.750549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98dbc-5154-490f-9d83-b28d25bbdce8 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:48.769176 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 398/790] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:50.420882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25fd14-3235-4cc7-bc8e-28c691cd194f None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:50.421412 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25fd14-3235-4cc7-bc8e-28c691cd194f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:50.421412 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25fd14-3235-4cc7-bc8e-28c691cd194f None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:50.422785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 393/791] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:50.428157 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:50.428594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:50.428834 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:50.445478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:50.446642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:50.515273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 399/792] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:50.539360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25fd14-3235-4cc7-bc8e-28c691cd194f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:50.639886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25fd14-3235-4cc7-bc8e-28c691cd194f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:50.674457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:50.675170 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:50.675454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:50.675731 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:50.676525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:50.678444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:50.690200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:50.691386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:50.692668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 394/793] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:50.698859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:50.793959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ede05-c2da-43aa-a9ab-1b4e4248f7b5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:50.825975 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:50.826631 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:50.826910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:50.827180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:50.827868 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:50.828197 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:50.829541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148b52f-0150-4e3d-8e55-36e6bbb1afc2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:50.834736 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 400/794] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:03:50.840373 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:50.939430 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d31d6-9266-4b20-ba71-fb7094d607f3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:50.971761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:50.972723 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:50.973003 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:50.973278 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:50.973969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:50.974268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:50.976722 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e817d-0ada-478e-a5a7-2b1fb83bed33 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:50.981307 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 395/795] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:51.100995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6b29-7f70-4fcd-ba0f-73073bf3dc53 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:51.101282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6b29-7f70-4fcd-ba0f-73073bf3dc53 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:51.101556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6b29-7f70-4fcd-ba0f-73073bf3dc53 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:51.102936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 401/796] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:51.108610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:51.108904 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:51.109187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:51.127119 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:51.128365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:51.197274 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 396/797] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:51.222576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a6b29-7f70-4fcd-ba0f-73073bf3dc53 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:51.322040 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a6b29-7f70-4fcd-ba0f-73073bf3dc53 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:51.356199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:51.356857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:51.357139 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:51.357416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:51.358123 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:51.359548 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:51.360951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING keystone.server.flask.common [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 07:03:51.379414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.sql.core [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 07:03:51.379414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 07:03:51.379414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [parameters: {'id': '00642ca2964e4318926bfd6e9bbbcad6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 07:03:51.379414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86910) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00642ca2964e4318926bfd6e9bbbcad6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00642ca2964e4318926bfd6e9bbbcad6. May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result = self._query(query) May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application conn.query(q) May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 07:03:51.398869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result.read() May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 07:03:51.399907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application next(self.gen) May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application yield resource May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application next(self.gen) May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.session.rollback() May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.force_reraise() May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise self.value May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application session.commit() May 12 07:03:51.401041 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._prepare_impl() May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.session.flush() May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._flush(objects) May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application compat.raise_( May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application flush_context.execute() May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 07:03:51.402380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rec.execute(self) May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 07:03:51.403488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result = self._query(query) May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application conn.query(q) May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result.read() May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 07:03:51.404558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [parameters: {'id': '00642ca2964e4318926bfd6e9bbbcad6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:51.405965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:51.406991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00642ca2964e4318926bfd6e9bbbcad6. May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:51.410285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 402/798] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 12 07:03:51 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:51.410973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:51.504671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d59b-d486-4172-bc31-eed26093b2e9 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:51.538893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:51.539686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:51.539965 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:51.540273 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:51.546703 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:51.548158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-ffd173d6-52b7-4d27-8226-4f7b98a1e614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:03:51.561906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:51.562970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:51.564482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 397/799] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:51.569982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:51.667807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ee93-0620-4e37-8aa3-05e068c4bcd5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:51.700049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:51.700732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:51.701015 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:51.701290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:51.702039 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:51.702345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:51.703972 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4df1-1dcb-492e-94c5-12c0c7c62087 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:51.724100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 403/800] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:53.318960 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaeda2-b029-46cd-adb7-b8204082c87d None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:53.319526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaeda2-b029-46cd-adb7-b8204082c87d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:53.319526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaeda2-b029-46cd-adb7-b8204082c87d None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:53.320908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 398/801] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:53.326177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36b11-6d59-4fda-9294-b096b62d6759 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:53.326580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36b11-6d59-4fda-9294-b096b62d6759 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:53.326739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36b11-6d59-4fda-9294-b096b62d6759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:53.343817 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-afb36b11-6d59-4fda-9294-b096b62d6759 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:53.345354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-afb36b11-6d59-4fda-9294-b096b62d6759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:53.414275 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 404/802] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:53.438511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaeda2-b029-46cd-adb7-b8204082c87d None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:53.536274 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaeda2-b029-46cd-adb7-b8204082c87d None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:53.569339 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:53.569931 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:53.570215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:53.570499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:53.571237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:53.572653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5cb9-2a1b-4a41-8e79-5a8b4848100a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:53.585856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 399/803] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:03:53 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:03:54.084702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b200-5caf-4855-a822-9e0e10a718ca None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:54.084990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b200-5caf-4855-a822-9e0e10a718ca None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:54.085363 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b200-5caf-4855-a822-9e0e10a718ca None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:54.086807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 405/804] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:54.092251 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:54.092620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:54.092905 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:54.109837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:54.111015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:54.181182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 400/805] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:54 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:54.206860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b200-5caf-4855-a822-9e0e10a718ca None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:54.306981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b200-5caf-4855-a822-9e0e10a718ca None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:54.340597 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:54.341197 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:54.341448 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:54.341721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:54.342416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:54.343849 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:54.357599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.sql.core [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 07:03:54.357599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 07:03:54.357599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [parameters: {'user_id': '37fb7f6ab2af478d92ccb3079549863b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 07:03:54.357599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86910) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result = self._query(query) May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application conn.query(q) May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result.read() May 12 07:03:54.364740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 07:03:54.365694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application next(self.gen) May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application yield resource May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application next(self.gen) May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.session.rollback() May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.force_reraise() May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise self.value May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application session.commit() May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 07:03:54.366811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._prepare_impl() May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.session.flush() May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._flush(objects) May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application compat.raise_( May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application flush_context.execute() May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rec.execute(self) May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 07:03:54.368016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 07:03:54.368921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result = self._query(query) May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application conn.query(q) May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application result.read() May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 07:03:54.370717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [parameters: {'user_id': '37fb7f6ab2af478d92ccb3079549863b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:54.372038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 07:03:54.373096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:54.374261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 406/806] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 12 07:03:54 2022] POST /identity/v3/users => generated 160 bytes in 160 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:54.374728 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:54.471461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd62378-26dc-4855-bc9a-5688d332d4b3 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:54.504093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:54.504900 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:54.505183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:54.505992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:54.513211 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:54.514635 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-9a5fc0f1-bf6f-4b52-b259-b569e0591a50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:03:54.529584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:54.530581 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:54.531527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 401/807] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:03:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:03:54.537174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:54.633828 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779692-a507-4d12-abfb-5da363eed340 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:54.665564 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:54.666229 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:54.666512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:54.666791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:54.667590 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:54.667900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:54.669560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01905f-7de2-49a8-a87c-491d734877d6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:54.706580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 407/808] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 12 07:03:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:55.898620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313afd5a-bf5b-4330-beba-5442d853a966 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:55.899153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313afd5a-bf5b-4330-beba-5442d853a966 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:55.899153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313afd5a-bf5b-4330-beba-5442d853a966 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:55.900559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 402/809] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:55.905808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:55.906182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:55.906366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:55.922746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:55.924265 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:55.986467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 408/810] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:55 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:03:56.011324 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313afd5a-bf5b-4330-beba-5442d853a966 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:56.106775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313afd5a-bf5b-4330-beba-5442d853a966 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:56.143098 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:56.144221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:56.144704 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:56.145207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:56.146896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:56.149323 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:56.163396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:56.164594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:03:56.165489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 403/811] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:56.171136 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:56.272744 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907d67-10e8-446d-a5b2-6dd38ce2dc67 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:56.304015 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:56.304688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:56.304965 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:56.305237 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:56.305931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:56.306233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:56.307584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:56.312341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 409/812] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:56.318608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:56.414247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a295-e45a-4d43-991f-85b02d3bae27 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:56.447329 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:56.448031 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:56.448359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:56.448654 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:56.449411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:56.449752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:56.451183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:56.456020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 404/813] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:56.462484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:56.555872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d86379-9a46-468a-ba29-517935c939a2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:56.588573 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:56.589215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:56.589497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:56.589775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:56.590563 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] RBAC: Adding query filter params (interface=public, service_id=8fd7a9568496445bae50920beeea4fbd, region_id=RegionOne) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:56.590875 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:56.592615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79553e3-8f5a-4eb7-8a9b-8aae6354c15d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:56.597766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 410/814] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:03:56 2022] GET /identity/v3/endpoints?service_id=8fd7a9568496445bae50920beeea4fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:56.603545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:56.698361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cc98-0a1d-4673-b269-86650653d520 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:56.729721 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:56.730370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:56.730652 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:56.730929 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:56.731603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:56.733029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ae14c-a4a3-43f1-b73d-77540116d7f4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:56.738942 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 405/815] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:03:56 2022] GET /identity/v3/services => generated 1728 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:03:59.175137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2c90-d77a-4e62-b640-fe438aef5d84 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.175672 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2c90-d77a-4e62-b640-fe438aef5d84 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.175672 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2c90-d77a-4e62-b640-fe438aef5d84 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.177666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 411/816] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:03:59.182759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.183161 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.183307 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.200745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:03:59.201958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:03:59.265493 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 406/817] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:03:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:03:59.289561 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2c90-d77a-4e62-b640-fe438aef5d84 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:59.388558 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2c90-d77a-4e62-b640-fe438aef5d84 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:59.422867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:59.423653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.423937 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.424243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.424894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:59.426314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:03:59.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:03:59.439098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:03:59.440147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 412/818] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:03:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:03:59.445868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:59.541864 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec641ac-9424-4193-a05f-b9b272d2771c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:59.573680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:59.574335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.574620 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.574897 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.575596 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:59.575903 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:59.577296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:59.581821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 407/819] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:59.588483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:59.682726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7559b-3d16-44b0-ae3a-af3fb7cc561a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:59.714113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:59.714756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.715037 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.715314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.716004 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:03:59.716341 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:59.717684 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9445c-2af5-4430-8666-8dfef2fb2c8d None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:59.722530 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 413/820] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 12 07:03:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:03:59.728434 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:03:59.823202 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b7995-4898-44f8-ad18-04b47710e694 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:03:59.855303 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:03:59.855961 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:03:59.856283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:03:59.856560 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:03:59.857309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:03:59.858666 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bea1f-59ba-4b28-b235-373320ef187e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:03:59.876404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 408/821] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:03:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:05:01.993560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ac7e-a987-44ec-9aee-6b4b0916d923 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:01.994452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ac7e-a987-44ec-9aee-6b4b0916d923 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:01.994452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ac7e-a987-44ec-9aee-6b4b0916d923 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:01.995985 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 414/822] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:02.003021 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:02.003526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:02.003734 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:02.025327 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:02.026771 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:02.116868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 409/823] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:02.147753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3ac7e-a987-44ec-9aee-6b4b0916d923 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:02.261152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3ac7e-a987-44ec-9aee-6b4b0916d923 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:02.303776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:02.304679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:02.304996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:02.305301 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:02.318710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:02.320480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:02.341178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:02.342480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:02.343632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:02.343632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:02.343632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:02.343632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:02.343632 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 415/824] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:02.353499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:02.472611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d0af-bfe7-4f23-a46b-113ff10690ec None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:02.516365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:02.516971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:02.517254 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:02.517530 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:02.518417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:02.518964 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:02.520649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfce722-fc74-4063-a0cc-333c044552b9 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:02.534905 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 410/825] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:02.540765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:02.655218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604996-9b8c-45ff-852c-69b4d25f9ced None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:02.693652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:02.694319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:02.694593 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:02.694914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:02.695635 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:02.697113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d13fb-4e8a-4383-b1ee-fd3f039ce8e3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:02.717483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 416/826] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 12 07:05:02 2022] POST /identity/v3/users => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:05:05.341524 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f160-cba2-425d-a91f-15f61f5b3119 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:05.342097 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f160-cba2-425d-a91f-15f61f5b3119 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:05.342097 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f160-cba2-425d-a91f-15f61f5b3119 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:05.343462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 411/827] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:05.350520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:05.350991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:05.351285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:05.372323 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:05.373702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:05.454911 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 417/828] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:05.487505 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f160-cba2-425d-a91f-15f61f5b3119 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:05.603310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f160-cba2-425d-a91f-15f61f5b3119 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:05.637502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:05.638426 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:05.638717 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:05.639011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:05.650740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:05.658605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:05.659720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:05.660795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 412/829] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:05.666269 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:05.777148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06a179-9d28-44b8-9134-c9cb19ce52c5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:05.815177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:05.816293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:05.816293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:05.816498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:05.817126 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:05.817426 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:05.818791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:05.827507 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 418/830] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:05.834053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:05.944184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4dde-b19a-4e88-932d-a76aa1beb6f8 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:05.981728 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:05.982508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:05.982796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:05.983131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:05.994095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:05.995746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:06.015162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:06.017022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:06.019112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:06.019112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:06.019112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:06.019112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:06.019112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 413/831] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:06.023247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:06.148909 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4475347-1f7c-4a4f-839b-e90af029fd04 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:06.187641 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:06.188352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:06.188639 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:06.188916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:06.189907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:06.190344 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:06.192100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:06.204807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 419/832] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:06.211180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:06.323880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f5d42-ac24-4eec-9559-7ba4d0af3600 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:06.363820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:06.364853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:06.365236 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:06.365839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:06.376474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:06.379005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:06.399110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:06.400644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:06.401607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 414/833] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:06.408804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:06.526853 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ce20-5073-4191-b550-18e571e7d2c4 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:06.563242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:06.563980 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:06.564245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:06.565137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:06.566141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:06.566462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:06.567900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:06.585387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 420/834] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:06.591689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:06.698565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c33a8-ba34-4a3f-9b7e-740e706f3d68 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:06.734411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:06.735066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:06.735348 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:06.735627 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:06.816417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:06.817094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:06.919009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 415/835] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:05:06 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 07:05:06.924838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:07.034592 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a245-b635-4f4c-b1fd-5c199903f68e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:07.068193 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:07.068922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:07.069203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:07.069479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:07.080598 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:07.082046 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:07.103765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:07.105084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:07.106137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:07.106137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:07.106137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:07.106137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:07.106137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 421/836] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:07.111210 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:07.216527 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96a2d-c518-40a3-9b6c-f3720fac17e6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:07.254271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:07.254961 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:07.255231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:07.255509 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:07.256281 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:07.256590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:07.257963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:07.270735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 416/837] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:07.276458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:07.383854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d1ec7-e1b3-4fbe-a0a5-f6588589d7f1 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:07.422022 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:07.422931 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:07.423282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:07.423567 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:07.431614 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:07.433281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:07.448108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:07.449293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:07.450520 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:07.452560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 422/838] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:07.458896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:07.561588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dc12d-667e-4d71-89c3-2a4172815e37 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:07.596558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:07.597231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:07.597510 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:07.597783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:07.598567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:07.598869 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:07.600433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee487f3-3726-4c1f-a9c5-bba820724630 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:07.613571 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 417/839] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:07.619935 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:07.730309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13843b-58e5-43e4-b479-ec55255cd5e9 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:07.772701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:07.773369 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:07.773657 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:07.773936 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:07.774767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=d81c7999cb2445fca81343d207963903) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:07.775081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:07.777208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b09d-1aba-4741-bb2a-014b4452f923 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:07.784841 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 423/840] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:05:07 2022] GET /identity/v3/role_assignments?user.id=d81c7999cb2445fca81343d207963903&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:10.335364 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2088-31db-4aab-a984-b408a25fb656 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:10.335940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2088-31db-4aab-a984-b408a25fb656 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:10.336060 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2088-31db-4aab-a984-b408a25fb656 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:10.337519 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 418/841] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:05:10.343618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:10.344059 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:10.344220 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:10.363569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:10.365062 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:10.439479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 424/842] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:10.464394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2088-31db-4aab-a984-b408a25fb656 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:10.572861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2088-31db-4aab-a984-b408a25fb656 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:10.615835 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:10.616800 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:10.617129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:10.617475 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:10.629028 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:10.636851 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:10.638190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:10.639355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 419/843] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:10.644905 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:10.750152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd9d8-12c6-4130-9e36-36c41f4bb462 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:10.785098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:10.785766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:10.786048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:10.786322 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:10.787070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:10.787397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:10.789081 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:10.799398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 425/844] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:10.805683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:10.913912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904bf42-c27a-4c05-b325-fa1956375a42 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:10.954593 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:10.956757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:10.957040 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:10.957338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:10.970052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:10.972521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:10.990839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:10.992148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:10.993181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:10.993181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:10.993181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:10.993181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:10.993181 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 420/845] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:10.998151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:11.116876 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683fbd-5351-450a-945b-a4bac9219ef5 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:11.153517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:11.154236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:11.154551 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:11.154864 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:11.155643 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:11.155952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:11.157414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:11.170085 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 426/846] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:11.176247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:11.294866 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962ab8-1a53-419d-8d8c-22becf9afa74 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:11.329991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:11.330906 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:11.331182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:11.331454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:11.339801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:11.341911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:11.358564 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:11.359755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:11.361710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 421/847] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:11.368373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:11.488247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6011-312d-47ef-b09c-55b84f71bf9b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:11.526666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:11.527398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:11.527715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:11.527997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:11.528924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:11.529239 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:11.530673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:11.550812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 427/848] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:11.557572 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:11.670809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05811a8-dfea-416c-933e-c5f1994e9d94 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:11.708096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:11.708856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:11.709142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:11.709518 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:11.722386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:11.723879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:11.741872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:11.742820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:11.743716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:11.743716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:11.743716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:11.743716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:11.743716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 422/849] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:05:11.748889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:11.856742 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2f98-496f-4f9a-8bfd-9f7e88056fc3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:11.890724 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:11.891582 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:11.891922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:11.892750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:11.894259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:11.894669 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:11.896368 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:11.911190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 428/850] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:11.917386 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:12.032459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ad0f9-b5f6-4ac4-8786-16ce1123a1ff None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:12.076905 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:12.077793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:12.078159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:12.078460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:12.087203 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:12.089017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:12.107207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:12.108374 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:12.109544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:12.114860 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 423/851] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:05:12.115992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:12.226250 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bf2bb-e946-480f-8068-d1a262d0cb58 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:12.260055 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:12.260782 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:12.261103 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:12.261426 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:12.262313 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:12.262629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:12.264066 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3f70b-f478-45a0-bcc1-7ef40ecee67a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:12.276568 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 429/852] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:12.282438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:12.388703 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17336-a86d-42f9-824e-4f3edb841d64 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:12.426853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:12.427864 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:12.428158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:12.428439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/d81c7999cb2445fca81343d207963903/roles/a13acf77e55448d0b01cacc060e5e212` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:12.445724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=d81c7999cb2445fca81343d207963903, role_id=a13acf77e55448d0b01cacc060e5e212)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:12.447671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61c536-d41d-425f-b390-68baec7f94f7 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:12.463626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 424/853] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:05:12 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/d81c7999cb2445fca81343d207963903/roles/a13acf77e55448d0b01cacc060e5e212 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:05:15.011257 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a222-0df5-4d70-87d1-9fbd931c8396 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.012096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a222-0df5-4d70-87d1-9fbd931c8396 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.012096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a222-0df5-4d70-87d1-9fbd931c8396 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.013444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 430/854] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:15.019014 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.019552 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.019662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.037983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:15.039213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:15.121109 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 425/855] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:15.149447 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a222-0df5-4d70-87d1-9fbd931c8396 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:15.257074 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a222-0df5-4d70-87d1-9fbd931c8396 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:15.294532 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:15.295309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.295588 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.295895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.309117 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:15.319637 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:15.320871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:15.321728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 431/856] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 12 07:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:15.327491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:15.438911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802198c3-49dd-4540-918d-d451963ca7f4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:15.477436 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:15.478328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.478653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.479002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.479961 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] RBAC: Adding query filter params (name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:15.480324 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:15.481685 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:15.492224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 426/857] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 12 07:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:15.499001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:15.609789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae8a9-9bca-46af-8578-aa2a26dd66e8 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:15.648162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:15.649032 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.649279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.649574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.661455 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:15.663012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:15.687797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:15.689049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:15.690776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:15.690776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:15.690776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:15.690776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:15.690776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 432/858] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:15.695871 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:15.802470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf0cd-4907-48e1-8b87-4f23c58eb1cf None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:15.836984 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:15.837731 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:15.837994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:15.838285 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:15.839106 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:15.839409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:15.840810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:15.853365 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 427/859] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:15.859380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:15.963316 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68f3d-34fb-464d-bfcd-ca8c725bddcb None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:16.003854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:16.004821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:16.005099 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:16.005372 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:16.014852 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:16.016456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:16.032302 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:16.034595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:16.035924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 433/860] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:16.040462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:16.156491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec250-4d6b-4936-b1d6-168ca4e12b08 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:16.194963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:16.195795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:16.196169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:16.196478 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:16.197359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:16.197673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:16.199110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:16.219114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 428/861] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:16.225699 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:16.327840 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b29330-a672-4b4d-bd0c-08e47123f108 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:16.364776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:16.365505 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:16.365819 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:16.366068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:16.442507 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:16.444391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:16.550741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 434/862] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:05:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 07:05:16.557118 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:16.663298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc02e-9a63-4e88-93fc-428e39f385ec None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:16.700689 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:16.701661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:16.701958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:16.702307 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:16.713172 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:16.714870 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:16.735361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:16.737162 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:16.738246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:16.738246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:16.738246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:16.738246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:16.738246 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 429/863] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:05:16.743031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:16.852497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c5980-4d7d-4a18-96cd-9cf3e2178457 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:16.889918 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:16.890670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:16.890955 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:16.891276 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:16.892604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:16.892918 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:16.894286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:16.906800 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 435/864] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:16.913532 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:17.032446 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012878-2544-4e52-aca2-e01a85912f01 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:17.070440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:17.071360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:17.071649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:17.072445 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:17.083160 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:17.085776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:17.103862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:17.105159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:17.106499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 430/865] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:17.113996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:17.218767 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c04af-5cf7-4f3b-9da4-40739ac2943a None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:17.254397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:17.255054 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:17.255347 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:17.255610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:17.256422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:17.256728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:17.258235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2d61-a4ac-4b3e-93ee-8f7233115170 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:17.272260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 436/866] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:17.278739 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:17.403243 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc26e9-76b7-4cae-8f32-7344c422ffd1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:17.444619 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:17.445342 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:17.445616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:17.445894 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:17.447003 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] RBAC: Adding query filter params (role.id=a13acf77e55448d0b01cacc060e5e212, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=d81c7999cb2445fca81343d207963903) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:17.447117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:17.448552 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf9c7a-d425-4514-b404-c8c6f01b685c None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:17.455260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 431/867] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:05:17 2022] GET /identity/v3/role_assignments?user.id=d81c7999cb2445fca81343d207963903&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=a13acf77e55448d0b01cacc060e5e212 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:19.860521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea109a9b-34ba-4d41-bd95-d12e016cb76c None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:19.861845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea109a9b-34ba-4d41-bd95-d12e016cb76c None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:19.861845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea109a9b-34ba-4d41-bd95-d12e016cb76c None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:19.863182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 437/868] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:19.868741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:19.869335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:19.869335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:19.886111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:19.887314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:19.959319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 432/869] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:05:19.985068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea109a9b-34ba-4d41-bd95-d12e016cb76c None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.090930 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea109a9b-34ba-4d41-bd95-d12e016cb76c None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:20.138515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:20.139644 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:20.140172 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:20.140702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:20.154215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:20.162177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:20.163743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:20.164697 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 438/870] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:20.173766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.278479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02b238-6eb0-4b62-83af-3cc47682d223 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:20.314186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:20.315056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:20.315340 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:20.315619 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:20.316472 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:20.316785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:20.318179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:20.326833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 433/871] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:20.332937 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.445618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fe58-288e-4fb5-a82b-2b846b4a15b2 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:20.484604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:20.485400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:20.486245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:20.486506 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:20.499002 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:20.500477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:20.517326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:20.523150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:20.524340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:20.524340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:20.524340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:20.524340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:20.524340 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 439/872] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:20.524724 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.627469 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2adba-4a8b-4cce-94e9-7a2836343c90 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:20.663907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:20.664606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:20.664890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:20.665165 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:20.665896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:20.666200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:20.667567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:20.679662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 434/873] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:20.685292 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.790975 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aba8c7-d999-4093-a1c2-d9a52636d6db None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:20.824916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:20.825737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:20.826021 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:20.826299 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:20.835666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:20.837180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:20.853391 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:20.854652 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:20.855797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 440/874] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:05:20.862757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:20.965597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a21bc8-5bcf-4c16-8b84-d78b353518b3 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.000082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.000795 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.001077 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.001904 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.002758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:21.003066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.004641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.023436 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 435/875] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:21.030152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:21.145508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eccbb7-f421-4aaa-a7db-8f2eabed682e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.184339 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.185083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.185430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.185772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.251773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.253262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.350129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 441/876] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 07:05:21.355809 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:21.451590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99640c-33d4-4bb8-8fac-017af70451cc None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.484610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.485395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.485816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.486088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.495528 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.496997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:21.513568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:21.514583 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:21.515648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:21.515648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:21.515648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:21.515648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:21.515648 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 436/877] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:21.521134 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:21.615045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd10f-f783-4242-968a-f3625494411e None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.647068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.647715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.647996 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.648377 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.649096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:21.649400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.650755 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.662148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 442/878] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:21.667640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:21.761372 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c11f-d659-4232-a083-de55808f6dc4 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.792862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.793636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.793916 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.794190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.800622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.802057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:21.815853 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:21.816911 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:21.818005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 437/879] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:21.822880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:21.917768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0e89-1804-417c-9008-4140f8e15180 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:21.949245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:21.949887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:21.950167 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:21.950442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:21.951218 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:21.951526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:21.952981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c5ee3-da7c-4c8d-8012-c2d592f37f1f None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:21.965004 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 443/880] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:21.971783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:22.066440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0aae-2be6-4d1c-9201-5d0efe35ad5a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:22.101641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:22.102397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:22.102676 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:22.103016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:22.103968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=d81c7999cb2445fca81343d207963903) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:22.104370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:22.105950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddce1c-e4d3-407c-a7d1-cc7ab9e0f359 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:22.112767 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 438/881] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:05:21 2022] GET /identity/v3/role_assignments?user.id=d81c7999cb2445fca81343d207963903&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:24.428796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efa5f-a365-41e6-8d99-cacd9badc36f None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:24.429512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efa5f-a365-41e6-8d99-cacd9badc36f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:24.429512 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efa5f-a365-41e6-8d99-cacd9badc36f None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:24.430699 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 444/882] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:24.436195 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:24.436616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:24.436760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:24.453356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:24.455049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:24.517959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 439/883] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:24.542223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2efa5f-a365-41e6-8d99-cacd9badc36f None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:24.636759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2efa5f-a365-41e6-8d99-cacd9badc36f None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:24.668721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:24.669486 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:24.669772 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:24.670045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:24.679602 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:24.687001 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:24.688102 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:24.689584 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 445/884] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:24.696363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:24.819621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9cf68-9c64-45bc-a455-ce8eda6d41e4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:24.852187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:24.852848 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:24.853131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:24.853405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:24.854154 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:24.854459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:24.855816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:24.863657 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 440/885] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:24.869483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:24.964981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd2c2d-115b-4aac-a4f3-14eb41e8df27 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:24.995841 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:24.996640 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:24.996922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:24.997199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.007691 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.009153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:25.025405 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:25.026525 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:25.027789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:25.027789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:25.027789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:25.027789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:25.027789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 446/886] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:25.032174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.139943 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fc7c-b470-422c-b3ec-3202ea9731b6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.174404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.175066 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.175348 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.175623 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.176376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:25.176681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.178036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.189183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 441/887] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:25.194898 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.290672 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c49c-baf2-414d-9f38-041c619001f3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.322010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.322784 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.323066 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.323342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.331991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.333588 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:25.347703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:25.348860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:25.349894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 447/888] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:25.354672 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.460540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352744d2-e48c-4f61-9692-3864c3d68a71 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.493496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.494158 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.494439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.494712 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.495540 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:25.495847 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.497300 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.514218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 442/889] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:25.519867 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.615739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbba4-dec6-442f-8289-56b418e18908 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.647095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.647870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.648179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.648462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.659289 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.660760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:25.677850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:25.678874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:25.679791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:25.679791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:25.679791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:25.679791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:25.679791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 448/890] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:25.684711 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.776884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d8f2-ea94-4e67-95f8-915b91b4bb4a None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.808781 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.809421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.809698 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.809971 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.810676 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:25.810977 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.812355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.822922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 443/891] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:25.828511 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:25.922668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2da5-11b3-470a-bec4-17c27f020f19 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:25.953679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:25.954954 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:25.955230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:25.955504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:25.961906 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:25.963326 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:25.977546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:25.978544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:25.979461 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 449/892] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:25.984562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:26.079114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a798753-14c5-4f59-a9fb-3c5d3be44346 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:26.117054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:26.117719 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:26.118006 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:26.118286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:26.119068 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:26.119381 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:26.120852 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd12e1-17c1-4adb-9866-ff77e725144d None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:26.133828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 444/893] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:26.139728 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:26.234318 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d76f-ee33-41aa-8751-f13bbe237c72 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:26.267262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:26.268156 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:26.268444 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:26.268722 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] PATH_INFO: `/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/d81c7999cb2445fca81343d207963903/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:26.270669 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] RBAC: Authorizing `identity:create_grant(project_id=de06908ab1d44487b63cc98d22f4d09e, user_id=d81c7999cb2445fca81343d207963903, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:26.272108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c7a8-2697-449a-a8f0-d922b93f418e None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:26.284725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 450/894] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 12 07:05:26 2022] PUT /identity/v3/projects/de06908ab1d44487b63cc98d22f4d09e/users/d81c7999cb2445fca81343d207963903/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:05:28.551454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688d59-78ab-4bb8-8903-14a7892b602f None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:28.551970 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688d59-78ab-4bb8-8903-14a7892b602f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:28.552201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688d59-78ab-4bb8-8903-14a7892b602f None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:28.553387 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 445/895] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:28.558466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:28.558914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:28.559018 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:28.575777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:28.576970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:28.639368 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 451/896] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:28.664436 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688d59-78ab-4bb8-8903-14a7892b602f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:28.760660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688d59-78ab-4bb8-8903-14a7892b602f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:28.792511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:28.793289 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:28.793573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:28.793852 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:28.803457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 07:05:28.811072 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:28.812173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:28.818536 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 446/897] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 12 07:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:28.819408 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:28.912414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81cf6b-1a2c-4caf-8daa-881be22f4eaf None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:28.945224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:28.945873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:28.946153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:28.946429 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:28.947165 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:28.947470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:28.948854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:28.957428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 452/898] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 12 07:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:28.962941 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:29.058342 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feaf95-7087-47b2-99f9-e401f314166f None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:29.091513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:29.092322 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:29.092608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:29.092891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:29.105760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:29.107409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:29.129321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:29.130231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:29.131117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:29.131117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:29.131117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:29.131117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:29.131117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 447/899] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:29.137524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:29.237804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f99c-6475-4719-93dd-84716422d8e3 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:29.269776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:29.270420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:29.270702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:29.270979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:29.271693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:29.271998 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:29.273390 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:29.284548 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 453/900] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:29.290217 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:29.384301 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca83f7-0fa5-4367-9881-71b564216ee9 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:29.415841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:29.416665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:29.416952 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:29.417229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:29.424604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:29.426040 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 07:05:29.440758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:29.441861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:29.442843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 448/901] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:29.447672 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:29.555769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880e88-4d48-4cd1-ae14-3a1556c49ca6 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:29.588288 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:29.588948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:29.589229 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:29.589504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:29.590329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:29.590638 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:29.592064 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:29.608516 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 454/902] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 12 07:05:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:29.615011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:29.708892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678a779-2c1b-4998-8427-26ba7d767ab6 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:29.741775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:29.742415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:29.742700 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:29.742986 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:29.808016 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:29.809509 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:29.902604 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 449/903] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 12 07:05:29 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 07:05:29.908354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:30.002947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61755689-0fcc-48fe-9f19-e3891e72c11b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:30.035075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:30.035853 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:30.036155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:30.036441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:30.046176 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:30.048255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 07:05:30.065082 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:30.066129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:30.067293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 07:05:30.067293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 07:05:30.067293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 07:05:30.067293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:30.067293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 455/904] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:30.071846 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:30.166922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9631-ef6b-43db-814b-16f45aeb53f1 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:30.200013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:30.200686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:30.200966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:30.201238 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:30.201940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:30.202241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:30.203591 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:30.214150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 450/905] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 12 07:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:30.220313 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:30.315376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35f18-440d-43c9-98da-0ebd4f3514ef None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:30.347517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:30.348304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:30.348586 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:30.348861 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:30.355332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:30.356790 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 07:05:30.370293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application with Lock( May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:30.371321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: ERROR keystone.server.flask.application May 12 07:05:30.372465 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 456/906] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 12 07:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:30.377213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:30.475309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536c01-fb1f-4572-93a7-073f89c75b71 None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:30.506226 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:30.506872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:30.507151 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:30.507424 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:30.508228 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:30.508535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:30.510063 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eaeb3-5afe-4eef-af3d-a6f611adc659 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:30.521875 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 451/907] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 12 07:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:30.527854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:30.623595 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7ee54-e752-424a-bf3f-6423f62ff24b None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:30.654949 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:30.655583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:30.655864 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:30.656159 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:30.657559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] RBAC: Adding query filter params (role.id=5f4db304bc714dcca08bff34b065a8f5, scope.project.id=de06908ab1d44487b63cc98d22f4d09e, user.id=d81c7999cb2445fca81343d207963903) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:30.657879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:30.659387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f6a4-7ba7-4197-b465-6bf1df4c737c None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:30.665007 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 457/908] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 12 07:05:30 2022] GET /identity/v3/role_assignments?user.id=d81c7999cb2445fca81343d207963903&scope.project.id=de06908ab1d44487b63cc98d22f4d09e&role.id=5f4db304bc714dcca08bff34b065a8f5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:32.967842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2684b-bcab-455e-8d2d-3f4a5a530cd4 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:32.968429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2684b-bcab-455e-8d2d-3f4a5a530cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:32.968429 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2684b-bcab-455e-8d2d-3f4a5a530cd4 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:32.970673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 452/909] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:32.975919 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:32.976403 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:32.976498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:32.992731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:32.993904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:33.056459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 458/910] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:33.081015 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2684b-bcab-455e-8d2d-3f4a5a530cd4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:33.190675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2684b-bcab-455e-8d2d-3f4a5a530cd4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:33.222899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:33.223628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:33.223910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:33.224337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:33.224990 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:33.226355 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:33.238053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:33.239227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:33.240259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 453/911] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 12 07:05:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 07:05:33.245458 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:33.338762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78eb65-8ec2-4d64-be2b-ee4ac7ce2f9b None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:33.371122 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:33.371769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:33.372051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:33.372356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:33.373057 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:33.373367 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:33.374721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415675a-3490-498a-8642-1146c0c70e69 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:33.379410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 459/912] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 12 07:05:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:33.385061 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:33.482389 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463209f6-dfac-42b7-85a0-03ab39ba046e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:33.523117 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:33.523786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:33.524071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:33.524381 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] PATH_INFO: `/v3/services` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:33.525090 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:33.525397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:33.526761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ea30e-06f8-491a-b5bd-6ab1cc3d1ac1 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:33.531042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 454/913] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 12 07:05:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:05:35.791599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4222a7-fb4a-495e-ae04-827ded24b5d2 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:35.792101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4222a7-fb4a-495e-ae04-827ded24b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:35.792101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4222a7-fb4a-495e-ae04-827ded24b5d2 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:35.793442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 460/914] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:35.799328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5e36-5a99-4fb5-955a-b430c122296f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:35.799751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5e36-5a99-4fb5-955a-b430c122296f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:35.799888 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5e36-5a99-4fb5-955a-b430c122296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:35.816927 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-b2dd5e36-5a99-4fb5-955a-b430c122296f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:35.818113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b2dd5e36-5a99-4fb5-955a-b430c122296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:35.882991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 455/915] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:35.906890 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4222a7-fb4a-495e-ae04-827ded24b5d2 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:36.002494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4222a7-fb4a-495e-ae04-827ded24b5d2 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:36.033837 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:36.034473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:36.034750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:36.035019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:36.035731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:36.037107 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339d38c-67f4-48f6-ac52-895cab3ce098 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:36.050594 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 461/916] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 12 07:05:35 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:05:38.361859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7f4c-4c8f-451a-8374-6eb3eed376e3 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:38.362409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7f4c-4c8f-451a-8374-6eb3eed376e3 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:38.362409 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7f4c-4c8f-451a-8374-6eb3eed376e3 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:38.363766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 456/917] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:38.368950 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:38.369387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:38.369508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:38.385815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:38.386992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:38.456456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 462/918] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:38 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 07:05:38.481259 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7f4c-4c8f-451a-8374-6eb3eed376e3 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:38.585279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7f4c-4c8f-451a-8374-6eb3eed376e3 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:38.621304 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:38.622017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:38.622296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:38.622568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] PATH_INFO: `/v3/services/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:38.623213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:38.624609 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:38.636534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:38.637662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:38.638695 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 457/919] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 12 07:05:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:38.644485 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:38.736715 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b99cc-27eb-46f0-b057-3bb6c95d3cf0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:38.768606 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:38.769255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:38.769533 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:38.769806 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:38.770495 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:38.770798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:38.772162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:38.776987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 463/920] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 12 07:05:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:38.783696 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:38.886658 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c043-162f-4bbf-8360-411f252a5fdf None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:38.918652 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:38.919295 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:38.919573 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:38.919845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:38.920653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] RBAC: Adding query filter params (interface=public, service_id=62245e80f761454c909e78d77ef7b269, region_id=RegionOne) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:38.920959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:38.922434 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb8e2-e1eb-4e38-8b26-4cabaa46a708 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:38.927394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 458/921] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 12 07:05:38 2022] GET /identity/v3/endpoints?service_id=62245e80f761454c909e78d77ef7b269&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:38.933011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:39.026276 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b947d-4b63-426f-b3fc-b24c9f9e2705 None admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:39.058474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:39.059112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:39.059386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:39.059659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:39.060348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:39.061692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2f02e-5638-4a1a-980c-e10ca415bab9 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:39.068052 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 464/922] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 12 07:05:38 2022] GET /identity/v3/services => generated 1962 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:05:41.352140 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c27a-e5de-440b-b616-bd7d07200425 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:41.352693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c27a-e5de-440b-b616-bd7d07200425 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:41.352693 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c27a-e5de-440b-b616-bd7d07200425 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:41.354052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 459/923] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:05:41.359195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:41.359686 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:41.359839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:41.376516 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:05:41.377670 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:05:41.440343 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 465/924] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:05:41 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 07:05:41.464264 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0c27a-e5de-440b-b616-bd7d07200425 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:41.561537 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0c27a-e5de-440b-b616-bd7d07200425 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:41.592414 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:41.593199 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:41.593482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:41.593758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:41.595160 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:41.596800 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:05:41.615248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:05:41.616411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application with Lock( May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self._enter() May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application return self.creator() May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application created_value = creator( May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: ERROR keystone.server.flask.application May 12 07:05:41.617435 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 460/925] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 12 07:05:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 07:05:41.624641 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:41.718308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489ecc-47f7-442c-bd3f-134e6fb9ee21 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:41.750094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:41.750920 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:41.751204 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:41.751479 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] PATH_INFO: `/v3/services` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:41.752200 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:05:41.752508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:41.753855 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de0472-78e8-4ec3-bd5d-9b897a480af6 None admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:41.758721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 466/926] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 12 07:05:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:05:41.764506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:05:41.859641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3e6-35a9-42cf-88bd-91616c89338e None admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:05:41.890576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:05:41.891998 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:05:41.892314 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:05:41.892595 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:05:41.893334 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:05:41.894687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf3c70-cbde-4c8d-8baf-e311f4eec596 None admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:05:41.912284 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 461/927] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 12 07:05:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:06:41.112071 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0754-e686-48d6-bfb1-b718e10e2d0a None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:41.112606 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0754-e686-48d6-bfb1-b718e10e2d0a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:41.112826 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0754-e686-48d6-bfb1-b718e10e2d0a None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:41.114029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 467/928] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:41.120747 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c45eca-6643-4424-8009-2d21a1a5bef6 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:41.121854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c45eca-6643-4424-8009-2d21a1a5bef6 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:41.122245 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c45eca-6643-4424-8009-2d21a1a5bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:41.143688 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-57c45eca-6643-4424-8009-2d21a1a5bef6 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:41.145294 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-57c45eca-6643-4424-8009-2d21a1a5bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:41.223616 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 462/929] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:41.278765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e041-e51d-4569-8a72-d1d93cf7781a None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:41.279085 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e041-e51d-4569-8a72-d1d93cf7781a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:41.279511 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e041-e51d-4569-8a72-d1d93cf7781a None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:41.281181 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 468/930] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 12 07:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:06:41.287043 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6282-82dc-4493-a45f-6b54b5cfdab4 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:41.287340 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6282-82dc-4493-a45f-6b54b5cfdab4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:41.287625 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6282-82dc-4493-a45f-6b54b5cfdab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:41.382383 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-82ba6282-82dc-4493-a45f-6b54b5cfdab4 None None] MFA Rules not processed for user `015718a382044581ba4fceb50c466ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:41.383737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-82ba6282-82dc-4493-a45f-6b54b5cfdab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:41.448830 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 463/931] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 12 07:06:41 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:41.457746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e041-e51d-4569-8a72-d1d93cf7781a None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:41.468462 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e041-e51d-4569-8a72-d1d93cf7781a None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:41.472115 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:41.472773 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:41.473053 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:41.473328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:41.482533 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:41.483945 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc21f2-369b-4f3c-95da-56dc4085ab2c service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:41.493173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 469/932] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:44.123760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aecd5-9135-41ba-a377-b7ce2884b548 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:44.124350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aecd5-9135-41ba-a377-b7ce2884b548 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:44.124350 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aecd5-9135-41ba-a377-b7ce2884b548 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:44.125715 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 464/933] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:44.130991 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9450a3-635c-4690-8fcd-0f4950af5e5f None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:44.131420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9450a3-635c-4690-8fcd-0f4950af5e5f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:44.131548 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9450a3-635c-4690-8fcd-0f4950af5e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:44.150449 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-ab9450a3-635c-4690-8fcd-0f4950af5e5f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:44.151635 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-ab9450a3-635c-4690-8fcd-0f4950af5e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:44.160246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 470/934] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:44.213628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9856640-aaf4-42a2-848f-b0536a1e77fb None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:44.213938 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9856640-aaf4-42a2-848f-b0536a1e77fb None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:44.214217 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9856640-aaf4-42a2-848f-b0536a1e77fb None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:44.215697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 465/935] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 12 07:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:44.222344 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc934-b3db-492b-b8db-9def3a47fd67 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:44.222634 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc934-b3db-492b-b8db-9def3a47fd67 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:44.222922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc934-b3db-492b-b8db-9def3a47fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:44.241432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-b60dc934-b3db-492b-b8db-9def3a47fd67 None None] MFA Rules not processed for user `015718a382044581ba4fceb50c466ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:44.242613 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b60dc934-b3db-492b-b8db-9def3a47fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:44.249802 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 471/936] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 12 07:06:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:44.258691 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9856640-aaf4-42a2-848f-b0536a1e77fb None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:44.269773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9856640-aaf4-42a2-848f-b0536a1e77fb None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:44.273444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:44.274082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:44.274369 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:44.274646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:44.283895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:44.285361 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8838e-39ae-4ffb-bf84-e7f49ada583b service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:44.295391 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 466/937] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:47.167060 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125b0-32e7-4168-a9a2-bfe8545e2d1d None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:47.167591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125b0-32e7-4168-a9a2-bfe8545e2d1d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:47.167591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125b0-32e7-4168-a9a2-bfe8545e2d1d None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:47.169173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 472/938] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:47.174310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522e21-7455-4132-aa28-e39f9db96f8b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:47.174735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522e21-7455-4132-aa28-e39f9db96f8b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:47.174863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522e21-7455-4132-aa28-e39f9db96f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:47.209461 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-c6522e21-7455-4132-aa28-e39f9db96f8b None None] MFA Rules not processed for user `c810e0311f9b44caa0b36ea9ab0e2a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:47.210629 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-c6522e21-7455-4132-aa28-e39f9db96f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:47.273636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 467/939] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:47 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:47.314175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275125b0-32e7-4168-a9a2-bfe8545e2d1d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:47.324673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275125b0-32e7-4168-a9a2-bfe8545e2d1d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:47.328583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:47.329216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:47.329501 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:47.329780 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:47.338555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:47.339984 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ad647-deae-4659-a318-fe50187b7c3d service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:47.350556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 473/940] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:47 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:50.217096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ac13-e122-492c-9e87-abbc7cb07276 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:50.217638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ac13-e122-492c-9e87-abbc7cb07276 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:50.217638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ac13-e122-492c-9e87-abbc7cb07276 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:50.218999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 468/941] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:50.224498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9cfc-6624-4884-af5f-4ca90bf63e95 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:50.224908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9cfc-6624-4884-af5f-4ca90bf63e95 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:50.225058 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9cfc-6624-4884-af5f-4ca90bf63e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:50.242186 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-8d7a9cfc-6624-4884-af5f-4ca90bf63e95 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:50.243370 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-8d7a9cfc-6624-4884-af5f-4ca90bf63e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:50.308049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 474/942] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:50 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:50.348517 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ac13-e122-492c-9e87-abbc7cb07276 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:50.359608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ac13-e122-492c-9e87-abbc7cb07276 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:50.363186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:50.363826 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:50.364113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:50.364420 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:50.374005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:50.375423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a4164-a560-4796-826e-510294e092af service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:50.384688 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 469/943] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:50 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:53.332104 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3895-4040-466c-90b7-f5d8d183ad28 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:53.332714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3895-4040-466c-90b7-f5d8d183ad28 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:53.332714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3895-4040-466c-90b7-f5d8d183ad28 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:53.334133 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 475/944] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:53.339421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662128-6730-4bbc-a5eb-6ec3520b5ded None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:53.339849 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662128-6730-4bbc-a5eb-6ec3520b5ded None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:53.339983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662128-6730-4bbc-a5eb-6ec3520b5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:53.358635 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-55662128-6730-4bbc-a5eb-6ec3520b5ded None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:53.359838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-55662128-6730-4bbc-a5eb-6ec3520b5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:53.368018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 470/945] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:53.405796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3895-4040-466c-90b7-f5d8d183ad28 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:53.415995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3895-4040-466c-90b7-f5d8d183ad28 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:53.419365 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:53.419992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:53.420309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:53.420587 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:53.429118 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:53.430524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861fc75-6179-4b39-beb2-e6d79b3d4afc service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:53.441534 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 476/946] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:55.769318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e75e-a973-4a47-8805-0b543b481d8a None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:55.769839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e75e-a973-4a47-8805-0b543b481d8a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:55.769839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e75e-a973-4a47-8805-0b543b481d8a None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:55.771110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 471/947] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:55.776333 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74146e2-b57f-438d-9164-d813c2944246 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:55.776761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74146e2-b57f-438d-9164-d813c2944246 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:55.776900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74146e2-b57f-438d-9164-d813c2944246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:55.794883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-c74146e2-b57f-438d-9164-d813c2944246 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:55.796075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-c74146e2-b57f-438d-9164-d813c2944246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:55.803848 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 477/948] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:06:55.840228 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e75e-a973-4a47-8805-0b543b481d8a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:55.851411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e75e-a973-4a47-8805-0b543b481d8a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:55.854875 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:55.855513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:55.855799 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:55.856080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:55.864710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:55.866169 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a2d0-4b61-4df0-a2a4-ab80dc432d5a service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:55.875791 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 472/949] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:58.245866 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca03-5c73-4335-8977-d1a5354ea81a None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:58.246397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca03-5c73-4335-8977-d1a5354ea81a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:58.246397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca03-5c73-4335-8977-d1a5354ea81a None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:58.247975 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 478/950] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:06:58.253104 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297bab-44f5-4051-ba03-f9245ef169cc None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:58.253543 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297bab-44f5-4051-ba03-f9245ef169cc None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:58.253776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297bab-44f5-4051-ba03-f9245ef169cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:58.271049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ea297bab-44f5-4051-ba03-f9245ef169cc None None] MFA Rules not processed for user `c810e0311f9b44caa0b36ea9ab0e2a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:06:58.272261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ea297bab-44f5-4051-ba03-f9245ef169cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:06:58.280789 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 473/951] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:06:58 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:06:58.318457 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacca03-5c73-4335-8977-d1a5354ea81a None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:58.328999 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacca03-5c73-4335-8977-d1a5354ea81a None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:58.332536 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:58.333188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:58.333501 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:58.333821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:58.343151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:58.344872 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316e7b-eeed-4493-ba4c-3c2981615117 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:58.354038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 479/952] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:06:58 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:01.037516 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ee93-c869-4ad9-84f4-ce0ecc677137 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:01.038032 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ee93-c869-4ad9-84f4-ce0ecc677137 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:01.038032 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ee93-c869-4ad9-84f4-ce0ecc677137 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:01.039403 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 474/953] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:01.044869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038930f-3e9a-4be1-8e5d-2f2076dfd1a3 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:01.045266 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038930f-3e9a-4be1-8e5d-2f2076dfd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:01.045418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038930f-3e9a-4be1-8e5d-2f2076dfd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:01.062409 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-9038930f-3e9a-4be1-8e5d-2f2076dfd1a3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:01.063589 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-9038930f-3e9a-4be1-8e5d-2f2076dfd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:01.071209 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 480/954] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:01.108872 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ee93-c869-4ad9-84f4-ce0ecc677137 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:01.119370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ee93-c869-4ad9-84f4-ce0ecc677137 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:01.123713 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:01.124381 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:01.124663 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:01.124939 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:01.133666 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:01.135084 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e5ec0-a654-4e9d-a950-f49872c452d5 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:01.144999 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 475/955] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:03.633348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b484-6eec-47f0-86d7-72fa188ae224 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:03.633896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b484-6eec-47f0-86d7-72fa188ae224 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:03.633896 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b484-6eec-47f0-86d7-72fa188ae224 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:03.635187 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 481/956] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:03.641007 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81968-e028-4a74-beec-f14224e3c757 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:03.641450 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81968-e028-4a74-beec-f14224e3c757 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:03.641638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81968-e028-4a74-beec-f14224e3c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:03.659026 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-b5a81968-e028-4a74-beec-f14224e3c757 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:03.660242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b5a81968-e028-4a74-beec-f14224e3c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:03.668301 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 476/957] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:03.710664 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b484-6eec-47f0-86d7-72fa188ae224 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:03.721600 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b484-6eec-47f0-86d7-72fa188ae224 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:03.725062 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:03.725698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:03.725982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:03.726259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:03.735511 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:03.736994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973d8b-bb39-4c1e-b260-56639891d017 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:03.747561 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 482/958] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:06.499788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64823-5345-4d85-a7e3-505dd5b61bbd None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:06.500297 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64823-5345-4d85-a7e3-505dd5b61bbd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:06.500391 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64823-5345-4d85-a7e3-505dd5b61bbd None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:06.501760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 477/959] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:06.506879 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2c5f-76f5-4d03-aff9-1496bb1d89d3 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:06.507296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2c5f-76f5-4d03-aff9-1496bb1d89d3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:06.507414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2c5f-76f5-4d03-aff9-1496bb1d89d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:06.525948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4c2d2c5f-76f5-4d03-aff9-1496bb1d89d3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:06.527133 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4c2d2c5f-76f5-4d03-aff9-1496bb1d89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:06.535037 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 483/960] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:06 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:06.571407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64823-5345-4d85-a7e3-505dd5b61bbd None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:06.582687 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64823-5345-4d85-a7e3-505dd5b61bbd None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:06.586153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:06.586788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:06.587074 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:06.587351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:06.596751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:06.598180 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c62f49-2ce6-4441-a415-c1a66d7b6feb service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:06.607451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 478/961] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:06 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:10.964658 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0d91-ed59-4682-b576-6baff8060ca4 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:10.965184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0d91-ed59-4682-b576-6baff8060ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:10.965184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0d91-ed59-4682-b576-6baff8060ca4 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:10.967384 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 484/962] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:10.972946 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5315-5023-471d-8baa-78f0e683997c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:10.973356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5315-5023-471d-8baa-78f0e683997c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:10.973454 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5315-5023-471d-8baa-78f0e683997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:10.991345 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2c5e5315-5023-471d-8baa-78f0e683997c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:10.993249 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2c5e5315-5023-471d-8baa-78f0e683997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:11.001261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 479/963] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:11.040620 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a0d91-ed59-4682-b576-6baff8060ca4 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:11.051400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a0d91-ed59-4682-b576-6baff8060ca4 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:11.054904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:11.055596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:11.055943 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:11.056318 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:11.065524 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:11.067013 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0f45a-3b60-4c94-b896-bef8db892d7d service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:11.076844 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 485/964] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:14.005504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd43e-d1f6-4aae-b4eb-25c4af167fb7 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:14.005988 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd43e-d1f6-4aae-b4eb-25c4af167fb7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:14.006111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd43e-d1f6-4aae-b4eb-25c4af167fb7 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:14.007397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 480/965] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:14.013732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd623b-0d1e-41ea-9de0-a4fb6596a90d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:14.014205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd623b-0d1e-41ea-9de0-a4fb6596a90d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:14.014297 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd623b-0d1e-41ea-9de0-a4fb6596a90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:14.034208 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2ecd623b-0d1e-41ea-9de0-a4fb6596a90d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:14.035398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2ecd623b-0d1e-41ea-9de0-a4fb6596a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:14.043008 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 486/966] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:14 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:14.082101 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cd43e-d1f6-4aae-b4eb-25c4af167fb7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:14.094290 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cd43e-d1f6-4aae-b4eb-25c4af167fb7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:14.098395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:14.099052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:14.099337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:14.099618 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:14.109337 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:14.110774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67f862-5c7c-4de7-9930-3c65d416ac31 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:14.120005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 481/967] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:14 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:18.520146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356dc7-1bd3-4c0d-b179-082ba13d0ab8 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:18.520659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356dc7-1bd3-4c0d-b179-082ba13d0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:18.520749 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356dc7-1bd3-4c0d-b179-082ba13d0ab8 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:18.522096 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 487/968] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:18.527415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97069-c407-4da6-87b6-b1bb91896e2c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:18.528388 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97069-c407-4da6-87b6-b1bb91896e2c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:18.528499 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97069-c407-4da6-87b6-b1bb91896e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:18.547023 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e7a97069-c407-4da6-87b6-b1bb91896e2c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:18.548275 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e7a97069-c407-4da6-87b6-b1bb91896e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:18.556793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 482/969] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:18.596636 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356dc7-1bd3-4c0d-b179-082ba13d0ab8 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:18.608315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356dc7-1bd3-4c0d-b179-082ba13d0ab8 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:18.611727 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:18.612411 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:18.612692 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:18.612967 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:18.622346 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:18.623794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e578-51c7-457d-8298-53b489e5dc4f service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:18.633191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 488/970] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:24.328586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1271d-5098-4a0c-890f-4bd9a5405300 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:24.329097 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1271d-5098-4a0c-890f-4bd9a5405300 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:24.329366 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1271d-5098-4a0c-890f-4bd9a5405300 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:24.330827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 483/971] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:24.337088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82b23-63a2-4ec0-b079-3f2e2b605ff5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:24.337693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82b23-63a2-4ec0-b079-3f2e2b605ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:24.338273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82b23-63a2-4ec0-b079-3f2e2b605ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:24.379555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-98f82b23-63a2-4ec0-b079-3f2e2b605ff5 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:24.380958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-98f82b23-63a2-4ec0-b079-3f2e2b605ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:24.484849 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 489/972] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:07:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:28.717638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298385-afc9-4020-915c-976544d5ed49 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:28.718178 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298385-afc9-4020-915c-976544d5ed49 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:28.718467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298385-afc9-4020-915c-976544d5ed49 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:28.720264 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 484/973] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:28.726910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8de2-4444-415d-9009-484dfba00b15 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:28.727356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8de2-4444-415d-9009-484dfba00b15 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:28.727460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8de2-4444-415d-9009-484dfba00b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:28.747726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-357c8de2-4444-415d-9009-484dfba00b15 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:28.748940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-357c8de2-4444-415d-9009-484dfba00b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:28.773076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 490/974] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:07:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:30.511554 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01aeb9-fdbb-4f8a-ba45-e2b61f415583 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:30.512070 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01aeb9-fdbb-4f8a-ba45-e2b61f415583 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:30.512816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01aeb9-fdbb-4f8a-ba45-e2b61f415583 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:30.514189 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 485/975] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:30.519262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a390-60d4-4ec2-8295-42150a873ec1 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:30.519683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a390-60d4-4ec2-8295-42150a873ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:30.519889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a390-60d4-4ec2-8295-42150a873ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:30.539294 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-9a63a390-60d4-4ec2-8295-42150a873ec1 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:30.540513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-9a63a390-60d4-4ec2-8295-42150a873ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:30.549987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 491/976] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:07:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:07:34.589055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f3a7-844a-455b-8f3f-8a74e1eea880 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:34.589601 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f3a7-844a-455b-8f3f-8a74e1eea880 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:34.589601 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f3a7-844a-455b-8f3f-8a74e1eea880 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:34.591198 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 486/977] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:34.596645 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135041f-d1ac-4573-bef2-73272c45711e None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:34.597063 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135041f-d1ac-4573-bef2-73272c45711e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:34.597198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135041f-d1ac-4573-bef2-73272c45711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:34.615484 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-9135041f-d1ac-4573-bef2-73272c45711e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:34.616964 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-9135041f-d1ac-4573-bef2-73272c45711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:34.626049 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 492/978] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:34.676197 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b23ce-aad5-4935-ba05-4f6a683be1c7 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:34.676710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b23ce-aad5-4935-ba05-4f6a683be1c7 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:34.676990 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b23ce-aad5-4935-ba05-4f6a683be1c7 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:34.678320 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 487/979] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 12 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:34.684711 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dcf6-45de-48cb-aae7-2e79bb08ad90 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:34.685003 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dcf6-45de-48cb-aae7-2e79bb08ad90 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:34.685420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dcf6-45de-48cb-aae7-2e79bb08ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:34.720242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2465dcf6-45de-48cb-aae7-2e79bb08ad90 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:34.721417 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2465dcf6-45de-48cb-aae7-2e79bb08ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:34.789878 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 493/980] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 12 07:07:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:34.798221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b23ce-aad5-4935-ba05-4f6a683be1c7 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:34.813256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b23ce-aad5-4935-ba05-4f6a683be1c7 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:34.818783 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:34.819511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:34.819863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:34.820810 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:34.830757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:34.832416 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1567f-9bd3-4f04-bd40-a8a5f50ceda2 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:34.842661 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 488/981] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:37.378199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060217-0d7e-4e2b-8055-702c99d1784c None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:37.378723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060217-0d7e-4e2b-8055-702c99d1784c None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:37.378825 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060217-0d7e-4e2b-8055-702c99d1784c None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:37.380145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 494/982] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:07:37.385340 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1835-a13b-437a-987a-d53faaa0fe8b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:37.385763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1835-a13b-437a-987a-d53faaa0fe8b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:37.385895 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1835-a13b-437a-987a-d53faaa0fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:37.404287 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-fc2b1835-a13b-437a-987a-d53faaa0fe8b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:37.405473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-fc2b1835-a13b-437a-987a-d53faaa0fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:37.413590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 489/983] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:37.460389 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e060217-0d7e-4e2b-8055-702c99d1784c None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:37.479870 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e060217-0d7e-4e2b-8055-702c99d1784c None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:37.488027 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:37.488990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:37.489410 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:37.489821 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:37.504254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:37.507145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ffa9-4c57-4b0f-b210-7c89bc97aac5 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:37.518400 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 495/984] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:40.177496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb99e-b997-491c-ac36-743590165785 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:40.178011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb99e-b997-491c-ac36-743590165785 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:40.178107 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb99e-b997-491c-ac36-743590165785 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:40.179410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 490/985] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:40.186739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec106-35fa-4a27-b4e4-e7a810dc6c56 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:40.187245 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec106-35fa-4a27-b4e4-e7a810dc6c56 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:40.187349 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec106-35fa-4a27-b4e4-e7a810dc6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:40.205247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d87ec106-35fa-4a27-b4e4-e7a810dc6c56 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:40.206430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d87ec106-35fa-4a27-b4e4-e7a810dc6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:40.214101 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 496/986] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:40.260085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f03-b087-489b-a2e0-3296d20f6654 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:40.260399 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f03-b087-489b-a2e0-3296d20f6654 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:40.260678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f03-b087-489b-a2e0-3296d20f6654 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:40.262649 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 491/987] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 12 07:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:40.268361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ec77-c27c-4a7c-b22a-cbf4308b2c11 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:40.268649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ec77-c27c-4a7c-b22a-cbf4308b2c11 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:40.268928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ec77-c27c-4a7c-b22a-cbf4308b2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:40.286519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2f18ec77-c27c-4a7c-b22a-cbf4308b2c11 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:40.287695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2f18ec77-c27c-4a7c-b22a-cbf4308b2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:40.296196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 497/988] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 12 07:07:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:07:40.303686 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f25f03-b087-489b-a2e0-3296d20f6654 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:40.317598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f25f03-b087-489b-a2e0-3296d20f6654 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:40.322453 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:40.323087 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:40.323364 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:40.323638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:40.332524 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:40.334099 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1138d15-c5b4-46e6-9838-c177831f72fb service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:40.343286 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 492/989] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:07:42.819721 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828933-186f-4280-990e-9e30bf3d98b1 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:42.820810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828933-186f-4280-990e-9e30bf3d98b1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:42.821246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828933-186f-4280-990e-9e30bf3d98b1 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:42.827364 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 498/990] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:42.829482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8bed-7e3c-4c3d-955f-3b30b02f332c None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:42.829910 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8bed-7e3c-4c3d-955f-3b30b02f332c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:42.830037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8bed-7e3c-4c3d-955f-3b30b02f332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:42.852237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2b0f8bed-7e3c-4c3d-955f-3b30b02f332c None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:42.853679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2b0f8bed-7e3c-4c3d-955f-3b30b02f332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:42.868482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 493/991] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:42.910335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828933-186f-4280-990e-9e30bf3d98b1 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:42.924990 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828933-186f-4280-990e-9e30bf3d98b1 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:42.930509 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:42.931329 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:42.931766 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:42.932260 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:42.943152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:42.945012 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa061b0-7f9d-4001-9655-894792700d1a service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:42.966583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 499/992] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:44.762311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db48d-1bdc-4a2a-a439-26a8d2b80657 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:44.762761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db48d-1bdc-4a2a-a439-26a8d2b80657 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:44.762949 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db48d-1bdc-4a2a-a439-26a8d2b80657 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:44.772737 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c115f5-161a-48e3-9bc0-0c7302918d82 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:44.773162 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c115f5-161a-48e3-9bc0-0c7302918d82 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:44.773570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c115f5-161a-48e3-9bc0-0c7302918d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:44.775878 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 494/993] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:44 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:44.808579 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-95c115f5-161a-48e3-9bc0-0c7302918d82 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:44.811357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-95c115f5-161a-48e3-9bc0-0c7302918d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:44.845026 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 500/994] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:45.203358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefef48-7f68-40bc-ab6f-cdc5d184c808 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.203358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefef48-7f68-40bc-ab6f-cdc5d184c808 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.203358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefef48-7f68-40bc-ab6f-cdc5d184c808 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.203358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 495/995] 10.222.0.71 () {54 vars in 963 bytes} [Thu May 12 07:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:45.209473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57416-b799-4e8c-88c4-cdac90eba687 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.209473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57416-b799-4e8c-88c4-cdac90eba687 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.209473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57416-b799-4e8c-88c4-cdac90eba687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.248690 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-5ab57416-b799-4e8c-88c4-cdac90eba687 None None] MFA Rules not processed for user `395edc9a3a5c4dc2b4dcc4f2a4d5e330`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:45.250311 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-5ab57416-b799-4e8c-88c4-cdac90eba687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:45.315865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 501/996] 10.222.0.71 () {58 vars in 1060 bytes} [Thu May 12 07:07:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:45.323208 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefef48-7f68-40bc-ab6f-cdc5d184c808 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:45.334425 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefef48-7f68-40bc-ab6f-cdc5d184c808 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:45.338080 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395edc9a3a5c4dc2b4dcc4f2a4d5e330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:45.338854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.339244 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.339624 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.349879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:45.351420 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed3d57-4b2b-4ae4-8751-d4faf7a4bcac service cinder] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:45.361311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 496/997] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:45.446386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dedbc4-333e-43ef-b612-f59fb034ad54 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.446673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dedbc4-333e-43ef-b612-f59fb034ad54 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.446951 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dedbc4-333e-43ef-b612-f59fb034ad54 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.448368 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 502/998] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:45.453697 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ab35-85c3-4cad-996d-085603bbd5d8 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.453983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ab35-85c3-4cad-996d-085603bbd5d8 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.454257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ab35-85c3-4cad-996d-085603bbd5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.472405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4388ab35-85c3-4cad-996d-085603bbd5d8 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:45.473575 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4388ab35-85c3-4cad-996d-085603bbd5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:45.481838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 497/999] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:45.526921 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dedbc4-333e-43ef-b612-f59fb034ad54 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:45.542342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dedbc4-333e-43ef-b612-f59fb034ad54 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:45.548024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:45.548714 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:45.548997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:45.549375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:45.557543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:45.559235 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06074b-8835-466b-b6e5-b759e6ff2581 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:45.568698 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 503/1000] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:47.961821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb950-5790-44d7-a977-c1827e3a5426 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:47.961821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb950-5790-44d7-a977-c1827e3a5426 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:47.962294 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb950-5790-44d7-a977-c1827e3a5426 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:47.963521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 498/1001] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:47.969665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8d82-0a6d-40b9-9638-d841c0d6dbc0 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:47.970093 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8d82-0a6d-40b9-9638-d841c0d6dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:47.970451 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8d82-0a6d-40b9-9638-d841c0d6dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:47.988947 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-1e3e8d82-0a6d-40b9-9638-d841c0d6dbc0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:47.990268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1e3e8d82-0a6d-40b9-9638-d841c0d6dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:47.998254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 504/1002] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:48.044462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb950-5790-44d7-a977-c1827e3a5426 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:48.065615 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb950-5790-44d7-a977-c1827e3a5426 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:48.070678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:48.071326 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:48.071613 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:48.071890 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:48.081247 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:48.082847 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1958c-b793-47c2-ac70-b9ee0e4b6f57 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:48.094907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 499/1003] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:07:50.468912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74645f8-13cb-4bef-9071-1dcf03d3dc9e None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:50.469456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74645f8-13cb-4bef-9071-1dcf03d3dc9e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:50.469456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74645f8-13cb-4bef-9071-1dcf03d3dc9e None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:50.471779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 505/1004] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:50.477740 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb3b-4b0b-4cea-b560-0a2b6bb9c6f8 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:50.478222 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb3b-4b0b-4cea-b560-0a2b6bb9c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:50.478336 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb3b-4b0b-4cea-b560-0a2b6bb9c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:50.496857 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d276eb3b-4b0b-4cea-b560-0a2b6bb9c6f8 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:50.498053 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d276eb3b-4b0b-4cea-b560-0a2b6bb9c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:50.508333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 500/1005] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:07:50.548152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74645f8-13cb-4bef-9071-1dcf03d3dc9e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:50.562317 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74645f8-13cb-4bef-9071-1dcf03d3dc9e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:50.567379 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:50.568141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:50.568513 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:50.568863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:50.577397 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:50.578968 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafd9ee-5ce8-4f22-bb8f-bea237c8ee08 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:50.588459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 506/1006] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:52.972669 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d667b-1962-49a4-a9cc-a4d5d47e718a None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:52.973257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d667b-1962-49a4-a9cc-a4d5d47e718a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:52.973257 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d667b-1962-49a4-a9cc-a4d5d47e718a None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:52.974998 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 501/1007] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:52.982161 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2682c-53b9-47cd-8dba-f79c5011be25 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:52.982736 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2682c-53b9-47cd-8dba-f79c5011be25 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:52.983119 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2682c-53b9-47cd-8dba-f79c5011be25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:53.002901 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-dcb2682c-53b9-47cd-8dba-f79c5011be25 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:53.004386 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-dcb2682c-53b9-47cd-8dba-f79c5011be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:53.013775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 507/1008] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:53.060800 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d667b-1962-49a4-a9cc-a4d5d47e718a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:53.078280 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d667b-1962-49a4-a9cc-a4d5d47e718a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:53.094963 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:53.096022 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:53.096460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:53.096741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:53.107434 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:53.109048 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c78c1-65b8-4d5e-97ff-8058848b34f6 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:53.119710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 502/1009] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:55.684574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfefc-605b-49e4-b50e-abda6c659421 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:55.699373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfefc-605b-49e4-b50e-abda6c659421 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:55.699373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfefc-605b-49e4-b50e-abda6c659421 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:55.699373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 508/1010] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:07:55.699973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994959-53fc-4afa-9fc3-421d31e15eb8 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:55.699973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994959-53fc-4afa-9fc3-421d31e15eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:55.699973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994959-53fc-4afa-9fc3-421d31e15eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:55.714182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ab994959-53fc-4afa-9fc3-421d31e15eb8 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:55.716969 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ab994959-53fc-4afa-9fc3-421d31e15eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:55.725141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 503/1011] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:55.778661 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dfefc-605b-49e4-b50e-abda6c659421 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:55.792200 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dfefc-605b-49e4-b50e-abda6c659421 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:55.798360 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:55.798994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:55.799275 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:55.799547 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:55.807777 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:55.810475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04563981-14bb-4a7d-b953-943c3c60fba2 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:55.819838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 509/1012] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:58.847854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fbda-ac04-4491-9c81-53439ffd2783 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:58.848507 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fbda-ac04-4491-9c81-53439ffd2783 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:58.848614 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fbda-ac04-4491-9c81-53439ffd2783 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:58.850444 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 504/1013] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:07:58.857416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b48a-4e19-48e8-8e31-6d9697feb8c8 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:58.858262 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b48a-4e19-48e8-8e31-6d9697feb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:58.858543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b48a-4e19-48e8-8e31-6d9697feb8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:58.886706 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-b4b7b48a-4e19-48e8-8e31-6d9697feb8c8 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:07:58.888045 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b4b7b48a-4e19-48e8-8e31-6d9697feb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:58.896597 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 510/1014] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:07:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:07:58.947537 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fbda-ac04-4491-9c81-53439ffd2783 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:58.962596 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fbda-ac04-4491-9c81-53439ffd2783 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:58.968839 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:58.969559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:58.969843 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:58.970124 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:58.979035 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:58.981463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34b5ce-995e-4fbe-a11d-b4db0db45e24 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:58.991255 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 505/1015] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:07:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:01.474348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2c3e-8c42-4b95-a582-0bfd4d287e4a None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.474982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2c3e-8c42-4b95-a582-0bfd4d287e4a None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.474982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2c3e-8c42-4b95-a582-0bfd4d287e4a None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.476269 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 511/1016] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:01.482827 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1f01-4419-41d9-b966-c62d4cc6f135 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.483288 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1f01-4419-41d9-b966-c62d4cc6f135 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.483397 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1f01-4419-41d9-b966-c62d4cc6f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.502449 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ac6b1f01-4419-41d9-b966-c62d4cc6f135 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:01.503651 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ac6b1f01-4419-41d9-b966-c62d4cc6f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:01.511383 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 506/1017] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:08:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:01.538460 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc64e8-add0-44eb-944b-35129d2ae351 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.538746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc64e8-add0-44eb-944b-35129d2ae351 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.539024 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc64e8-add0-44eb-944b-35129d2ae351 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.540424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 512/1018] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:01.545869 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c1f0-a64a-42ee-ae27-4e3194100ad0 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.546033 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c1f0-a64a-42ee-ae27-4e3194100ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.546427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c1f0-a64a-42ee-ae27-4e3194100ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.556850 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc64e8-add0-44eb-944b-35129d2ae351 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:01.564179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-1c71c1f0-a64a-42ee-ae27-4e3194100ad0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:01.565368 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-1c71c1f0-a64a-42ee-ae27-4e3194100ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:01.570243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc64e8-add0-44eb-944b-35129d2ae351 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:01.573213 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 507/1019] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:08:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:01.576142 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:01.576796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.577077 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.577350 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.585615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:01.587183 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66620af8-1b79-40b6-a4ba-232f8fa73a9f service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:01.597470 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 513/1020] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:08:01.633637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b928ee3-8221-472e-95ce-64e5e913cd11 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.634005 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b928ee3-8221-472e-95ce-64e5e913cd11 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.634298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b928ee3-8221-472e-95ce-64e5e913cd11 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.635953 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 508/1021] 10.222.0.71 () {54 vars in 962 bytes} [Thu May 12 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:01.641375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4d20-557d-4e56-8aed-bb0cce23d670 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.641666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4d20-557d-4e56-8aed-bb0cce23d670 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.641942 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4d20-557d-4e56-8aed-bb0cce23d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.689069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-42ec4d20-557d-4e56-8aed-bb0cce23d670 None None] MFA Rules not processed for user `3c9ac81291744cc1aca09035350296c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:01.690214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-42ec4d20-557d-4e56-8aed-bb0cce23d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:01.754713 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 514/1022] 10.222.0.71 () {58 vars in 1059 bytes} [Thu May 12 07:08:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:01.762779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b928ee3-8221-472e-95ce-64e5e913cd11 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:01.773731 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b928ee3-8221-472e-95ce-64e5e913cd11 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:01.777922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9ac81291744cc1aca09035350296c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:01.778586 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:01.778867 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:01.779200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:01.789508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:01.790968 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d565-d441-40fa-9710-80f487e02ca3 service glance] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:01.801439 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 509/1023] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:04.020478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722a0a-19ef-4c3b-b0a0-53ab122e5ae4 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:04.021182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722a0a-19ef-4c3b-b0a0-53ab122e5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:04.021182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722a0a-19ef-4c3b-b0a0-53ab122e5ae4 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:04.022440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 515/1024] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:04.028141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9fcb-5ed0-4b01-abd5-8b0d7c21535d None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:04.028652 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9fcb-5ed0-4b01-abd5-8b0d7c21535d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:04.028764 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9fcb-5ed0-4b01-abd5-8b0d7c21535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:04.046660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-7f2b9fcb-5ed0-4b01-abd5-8b0d7c21535d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:04.047882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-7f2b9fcb-5ed0-4b01-abd5-8b0d7c21535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:04.055579 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 510/1025] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:08:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:08:04.106213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3722a0a-19ef-4c3b-b0a0-53ab122e5ae4 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:04.129215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3722a0a-19ef-4c3b-b0a0-53ab122e5ae4 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:04.134255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:04.134977 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:04.135335 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:04.135763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:04.144823 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:04.146418 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4f8c4-f565-459e-8cd6-e2c7adb60b5c service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:04.156481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 516/1026] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:17.018879 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab650-ba87-4f44-8ee9-ebf3c0739308 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:17.019523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab650-ba87-4f44-8ee9-ebf3c0739308 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:17.019523 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab650-ba87-4f44-8ee9-ebf3c0739308 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:17.020841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 511/1027] 10.222.0.71 () {54 vars in 918 bytes} [Thu May 12 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:17.025926 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fac4e-753a-4b62-8baa-33f91959a998 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:17.026406 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fac4e-753a-4b62-8baa-33f91959a998 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:17.026516 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fac4e-753a-4b62-8baa-33f91959a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:17.045568 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-240fac4e-753a-4b62-8baa-33f91959a998 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:17.046779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-240fac4e-753a-4b62-8baa-33f91959a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:17.055118 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 517/1028] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 12 07:08:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:17.069545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3de22-0244-4afb-b816-6876d84f6920 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:17.069832 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3de22-0244-4afb-b816-6876d84f6920 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:17.070111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3de22-0244-4afb-b816-6876d84f6920 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:17.071448 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 512/1029] 10.222.0.71 () {54 vars in 918 bytes} [Thu May 12 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:17.076145 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bd018-a8bd-4941-a9b8-7b52dbb30451 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:17.076442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bd018-a8bd-4941-a9b8-7b52dbb30451 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:17.076726 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bd018-a8bd-4941-a9b8-7b52dbb30451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:17.094815 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2a5bd018-a8bd-4941-a9b8-7b52dbb30451 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:17.096304 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2a5bd018-a8bd-4941-a9b8-7b52dbb30451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:17.106854 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 518/1030] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 12 07:08:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:19.877798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9c45-8e46-4757-8b5d-60255f806c2c None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:19.878347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9c45-8e46-4757-8b5d-60255f806c2c None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:19.878347 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9c45-8e46-4757-8b5d-60255f806c2c None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:19.879671 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:19.885011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaee2-99c2-47cd-b328-4ea1ab621741 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:19.885459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaee2-99c2-47cd-b328-4ea1ab621741 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:19.885563 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaee2-99c2-47cd-b328-4ea1ab621741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:19.903469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-872aaee2-99c2-47cd-b328-4ea1ab621741 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:19.904685 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-872aaee2-99c2-47cd-b328-4ea1ab621741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:19.912464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:19.955716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb9c45-8e46-4757-8b5d-60255f806c2c None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:19.968755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb9c45-8e46-4757-8b5d-60255f806c2c None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:19.973925 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:19.974559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:19.974845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:19.975123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:19.983088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:19.984782 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933f4c-761e-4431-b136-8c26e32f88b5 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:19.993899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 514/1033] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:21.009515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139f5-2e26-40da-90d2-488fcfa08649 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:21.010091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139f5-2e26-40da-90d2-488fcfa08649 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:21.010091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139f5-2e26-40da-90d2-488fcfa08649 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:21.012006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:21.017002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e620-6dad-4a6f-9e10-58d97f14675b None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:21.017427 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e620-6dad-4a6f-9e10-58d97f14675b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:21.017587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e620-6dad-4a6f-9e10-58d97f14675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:21.035641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-38b8e620-6dad-4a6f-9e10-58d97f14675b None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:21.036885 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-38b8e620-6dad-4a6f-9e10-58d97f14675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:21.044959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:21.252428 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1139f5-2e26-40da-90d2-488fcfa08649 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:21.265940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1139f5-2e26-40da-90d2-488fcfa08649 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:21.270770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:21.271390 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:21.271668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:21.271944 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:21.280553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:21.282113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e4e80-57ef-45d6-9707-592a4878def7 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:21.291048 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 521/1036] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:22.283938 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30178-d599-4e89-970d-58130bc91d01 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:22.284553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30178-d599-4e89-970d-58130bc91d01 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:22.284553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30178-d599-4e89-970d-58130bc91d01 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:22.285884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:22.290981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e92-951b-4db6-91bc-7ee9eee9f13d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:22.291430 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e92-951b-4db6-91bc-7ee9eee9f13d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:22.291527 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e92-951b-4db6-91bc-7ee9eee9f13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:22.310204 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-8cf49e92-951b-4db6-91bc-7ee9eee9f13d None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:22.311383 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-8cf49e92-951b-4db6-91bc-7ee9eee9f13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:22.319054 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:22.471994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30178-d599-4e89-970d-58130bc91d01 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:22.485550 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30178-d599-4e89-970d-58130bc91d01 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:22.490309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:22.490938 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:22.491215 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:22.491487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:22.499452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:22.501051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e245d5d-95d5-4f0b-98ba-63bf51ab3bf5 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:22.510063 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 517/1039] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:23.446237 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546d3b-3875-49cd-8aa8-354776c8ba75 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:23.446743 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546d3b-3875-49cd-8aa8-354776c8ba75 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:23.446859 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546d3b-3875-49cd-8aa8-354776c8ba75 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:23.448168 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:23.453982 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4929-dea8-4240-b5b3-a4ffbaa37b56 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:23.454562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4929-dea8-4240-b5b3-a4ffbaa37b56 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:23.454562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4929-dea8-4240-b5b3-a4ffbaa37b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:23.473187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-7a2f4929-dea8-4240-b5b3-a4ffbaa37b56 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:23.474363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-7a2f4929-dea8-4240-b5b3-a4ffbaa37b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:23.482231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:08:23.638038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1546d3b-3875-49cd-8aa8-354776c8ba75 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:23.651168 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1546d3b-3875-49cd-8aa8-354776c8ba75 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:23.656051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:23.656703 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:23.656979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:23.657249 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:23.665137 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:23.666701 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4db7-9385-464b-adb3-cdf2c9c1a718 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:23.676375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 524/1042] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:24.621417 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dde1f-039f-4e99-bcf5-4ad5f3183638 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:24.621976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dde1f-039f-4e99-bcf5-4ad5f3183638 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:24.621976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dde1f-039f-4e99-bcf5-4ad5f3183638 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:24.623315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:24.628215 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd0e3-7742-45d6-a90f-ea42bb358124 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:24.628646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd0e3-7742-45d6-a90f-ea42bb358124 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:24.628759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd0e3-7742-45d6-a90f-ea42bb358124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:24.647148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-263dd0e3-7742-45d6-a90f-ea42bb358124 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:24.648414 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-263dd0e3-7742-45d6-a90f-ea42bb358124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:24.656740 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:24.811248 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dde1f-039f-4e99-bcf5-4ad5f3183638 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:24.824474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dde1f-039f-4e99-bcf5-4ad5f3183638 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:24.829292 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:24.829949 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:24.830231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:24.830506 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:24.838229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:24.840737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb65f-dae0-4465-a472-6fb11bfc995c service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:24.849983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 520/1045] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:25.737270 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5850-dd26-4659-91a7-d882f79b6169 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:25.737811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5850-dd26-4659-91a7-d882f79b6169 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:25.737811 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5850-dd26-4659-91a7-d882f79b6169 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:25.739105 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:25.744049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2490-df38-4b80-b015-79960e65f984 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:25.744483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2490-df38-4b80-b015-79960e65f984 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:25.744644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2490-df38-4b80-b015-79960e65f984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:25.762489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ec5d2490-df38-4b80-b015-79960e65f984 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:25.763664 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ec5d2490-df38-4b80-b015-79960e65f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:25.771222 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:25.923425 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5850-dd26-4659-91a7-d882f79b6169 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:25.937051 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5850-dd26-4659-91a7-d882f79b6169 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:25.942296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:25.942929 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:25.943212 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:25.943493 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:25.951618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:25.953230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a0cfe-9a01-414b-af1e-800427a5d51f service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:25.962370 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 527/1048] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:26.833557 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0f9e-71d2-415b-ad64-6bc25fc0f89a None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:26.834090 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0f9e-71d2-415b-ad64-6bc25fc0f89a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:26.834090 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0f9e-71d2-415b-ad64-6bc25fc0f89a None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:26.835353 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:26.840200 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249f26c-8800-4959-bccb-17b67b5e75ea None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:26.840661 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249f26c-8800-4959-bccb-17b67b5e75ea None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:26.840769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249f26c-8800-4959-bccb-17b67b5e75ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:26.859396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4249f26c-8800-4959-bccb-17b67b5e75ea None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:26.860605 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4249f26c-8800-4959-bccb-17b67b5e75ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:26.868300 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:27.024952 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af0f9e-71d2-415b-ad64-6bc25fc0f89a None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:27.038191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af0f9e-71d2-415b-ad64-6bc25fc0f89a None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:27.046892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:27.047553 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:27.047837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:27.048114 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:27.056863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:27.059209 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0979e7-2d74-499c-a0b8-dbc6aaee8bd5 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:27.068372 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 523/1051] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:27.946914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca60278-16fa-47a9-b86f-93d38258cdbe None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:27.947453 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca60278-16fa-47a9-b86f-93d38258cdbe None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:27.947571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca60278-16fa-47a9-b86f-93d38258cdbe None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:27.949043 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:27.953845 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fcda-3b3b-4aff-8e1f-c5c777cd57a0 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:27.954260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fcda-3b3b-4aff-8e1f-c5c777cd57a0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:27.954400 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fcda-3b3b-4aff-8e1f-c5c777cd57a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:27.972076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-e805fcda-3b3b-4aff-8e1f-c5c777cd57a0 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:27.973283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-e805fcda-3b3b-4aff-8e1f-c5c777cd57a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:27.981483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:28.134836 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca60278-16fa-47a9-b86f-93d38258cdbe None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:28.148192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca60278-16fa-47a9-b86f-93d38258cdbe None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:28.153748 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:28.154380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:28.154660 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:28.154937 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:28.162786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:28.164409 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3866-4a69-4af7-bfc0-ae8e92ff3a17 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:28.174247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 530/1054] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:29.071788 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e461bd-1b04-475d-96b5-5c9c9cf579c5 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.072401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e461bd-1b04-475d-96b5-5c9c9cf579c5 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.072401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e461bd-1b04-475d-96b5-5c9c9cf579c5 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.073784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:29.078611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a33ac-724f-4207-8cf4-5ddc1e72fb48 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.079014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a33ac-724f-4207-8cf4-5ddc1e72fb48 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.079159 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a33ac-724f-4207-8cf4-5ddc1e72fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.097493 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-107a33ac-724f-4207-8cf4-5ddc1e72fb48 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:29.098655 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-107a33ac-724f-4207-8cf4-5ddc1e72fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:29.107798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:08:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:29.260750 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e461bd-1b04-475d-96b5-5c9c9cf579c5 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.275007 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e461bd-1b04-475d-96b5-5c9c9cf579c5 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.280776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.281418 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.281702 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.281976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.289976 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.291545 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1516e1-5ac3-41a4-9650-2b0909e97e3a service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.300673 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 526/1057] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:31.454796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4bc00-9f0f-481e-b95c-e921f8f1ed2e None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:31.455320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4bc00-9f0f-481e-b95c-e921f8f1ed2e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:31.455320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4bc00-9f0f-481e-b95c-e921f8f1ed2e None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:31.457069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:31.462786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa5f1-e478-4a4c-b00c-f567c68a756e None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:31.463229 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa5f1-e478-4a4c-b00c-f567c68a756e None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:31.463321 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa5f1-e478-4a4c-b00c-f567c68a756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:31.481092 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-2a8aa5f1-e478-4a4c-b00c-f567c68a756e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:31.482260 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-2a8aa5f1-e478-4a4c-b00c-f567c68a756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:31.489836 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:31.529339 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4bc00-9f0f-481e-b95c-e921f8f1ed2e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:31.546065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4bc00-9f0f-481e-b95c-e921f8f1ed2e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:31.549526 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:31.550153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:31.550426 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:31.550695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:31.560473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:31.561881 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f82a0c-4b0b-497b-9746-326724786776 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:31.570857 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 533/1060] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:33.977587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112741e-71ce-473a-8c94-8e52f2b2b50e None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:33.978128 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112741e-71ce-473a-8c94-8e52f2b2b50e None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:33.978128 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112741e-71ce-473a-8c94-8e52f2b2b50e None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:33.979479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:33.985323 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185d4b-adde-4479-8a97-523175dbe6fc None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:33.985762 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185d4b-adde-4479-8a97-523175dbe6fc None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:33.985912 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185d4b-adde-4479-8a97-523175dbe6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:34.004130 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-f9185d4b-adde-4479-8a97-523175dbe6fc None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:34.005330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-f9185d4b-adde-4479-8a97-523175dbe6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:34.013983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:34.052856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112741e-71ce-473a-8c94-8e52f2b2b50e None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:34.064032 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112741e-71ce-473a-8c94-8e52f2b2b50e None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:34.067521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:34.070051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:34.070051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:34.070051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:34.078039 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:34.079462 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2edd9-f17b-42e4-89ee-5fea10501739 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:34.088544 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 529/1063] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:36.693431 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486f1f-f011-4c1a-b361-b5f9d8b4460b None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:36.693950 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486f1f-f011-4c1a-b361-b5f9d8b4460b None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:36.693950 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486f1f-f011-4c1a-b361-b5f9d8b4460b None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:36.695284 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:36.701310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1110-ba33-4ff0-8e4a-0220fe7e6dbf None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:36.701753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1110-ba33-4ff0-8e4a-0220fe7e6dbf None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:36.701882 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1110-ba33-4ff0-8e4a-0220fe7e6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:36.719611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-dbbc1110-ba33-4ff0-8e4a-0220fe7e6dbf None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:36.721073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-dbbc1110-ba33-4ff0-8e4a-0220fe7e6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:36.728653 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:36.768413 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486f1f-f011-4c1a-b361-b5f9d8b4460b None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:36.779171 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486f1f-f011-4c1a-b361-b5f9d8b4460b None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:36.782693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:36.783328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:36.783607 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:36.783883 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:36.793449 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:36.794886 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40b85-5bb5-4c4b-95cf-e8b4e2579845 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:36.804095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 536/1066] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:39.254096 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c73f-ce14-4985-8cc6-d886a2e4cdb4 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:39.254679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c73f-ce14-4985-8cc6-d886a2e4cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:39.254679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c73f-ce14-4985-8cc6-d886a2e4cdb4 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:39.256017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:39.262278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4b94-b39c-4b8a-b2f9-018bd36ee5b1 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:39.262741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4b94-b39c-4b8a-b2f9-018bd36ee5b1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:39.262856 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4b94-b39c-4b8a-b2f9-018bd36ee5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:39.281563 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e9cb4b94-b39c-4b8a-b2f9-018bd36ee5b1 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:39.282760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e9cb4b94-b39c-4b8a-b2f9-018bd36ee5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:39.290406 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:39.329575 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c73f-ce14-4985-8cc6-d886a2e4cdb4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:39.341438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c73f-ce14-4985-8cc6-d886a2e4cdb4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:39.344991 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:39.345634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:39.346182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:39.346455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:39.355482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:39.356936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926989-94c0-4696-acb3-4a5d8ad9e313 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:39.366112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 532/1069] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:41.684688 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58e6f-8469-441f-b659-09cb138b149f None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:41.685236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58e6f-8469-441f-b659-09cb138b149f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:41.685236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58e6f-8469-441f-b659-09cb138b149f None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:41.686569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:41.691915 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b6ade-9e94-4d66-8c8e-27fa959bab7e None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:41.692376 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b6ade-9e94-4d66-8c8e-27fa959bab7e None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:41.692496 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b6ade-9e94-4d66-8c8e-27fa959bab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:41.710055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ea5b6ade-9e94-4d66-8c8e-27fa959bab7e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:41.711231 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ea5b6ade-9e94-4d66-8c8e-27fa959bab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:41.720183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:41.758521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58e6f-8469-441f-b659-09cb138b149f None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:41.769402 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58e6f-8469-441f-b659-09cb138b149f None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:41.772860 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:41.773482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:41.773764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:41.774038 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:41.783519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:41.784966 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c181c-ee28-4511-ae6c-37d2b1d6ece6 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:41.795010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 539/1072] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:44.155069 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af890-eaf3-44b8-8e70-b2a8040bdcb4 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:44.155640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af890-eaf3-44b8-8e70-b2a8040bdcb4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:44.155640 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af890-eaf3-44b8-8e70-b2a8040bdcb4 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:44.157018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:44.162234 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1f9f-425c-4cf9-88a0-d418e72bd9b5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:44.162666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1f9f-425c-4cf9-88a0-d418e72bd9b5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:44.162797 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1f9f-425c-4cf9-88a0-d418e72bd9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:44.180620 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e32d1f9f-425c-4cf9-88a0-d418e72bd9b5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:44.181804 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e32d1f9f-425c-4cf9-88a0-d418e72bd9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:44.189679 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:08:44.228221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af890-eaf3-44b8-8e70-b2a8040bdcb4 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:44.239479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af890-eaf3-44b8-8e70-b2a8040bdcb4 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:44.242998 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:44.243628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:44.243912 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:44.244225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:44.253207 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:44.254632 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044b89-b16c-41e4-8b0f-057f1835828f service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:44.264662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 535/1075] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:46.578824 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2fb7c-51ad-4115-8314-65c24bd6d07c None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:46.579305 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2fb7c-51ad-4115-8314-65c24bd6d07c None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:46.579422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2fb7c-51ad-4115-8314-65c24bd6d07c None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:46.580770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:46.585974 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732c086-3dd2-4eb2-b200-a53c84324f1a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:46.586394 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732c086-3dd2-4eb2-b200-a53c84324f1a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:46.586528 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732c086-3dd2-4eb2-b200-a53c84324f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:46.604765 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d732c086-3dd2-4eb2-b200-a53c84324f1a None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:46.606062 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d732c086-3dd2-4eb2-b200-a53c84324f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:46.613681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:46.651473 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2fb7c-51ad-4115-8314-65c24bd6d07c None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:46.662499 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2fb7c-51ad-4115-8314-65c24bd6d07c None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:46.665993 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:46.666617 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:46.666899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:46.667182 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:46.675849 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:46.677305 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2138-e457-44e3-a501-8e912d09c9ed service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:46.686528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 542/1078] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:49.050042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382bef5-b4bc-4ee2-8e1f-caaace7f2eb0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:49.050642 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382bef5-b4bc-4ee2-8e1f-caaace7f2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:49.050642 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382bef5-b4bc-4ee2-8e1f-caaace7f2eb0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:49.051958 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:49.057261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf282c5-6c01-41df-9318-b0677e6fdee2 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:49.057695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf282c5-6c01-41df-9318-b0677e6fdee2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:49.057839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf282c5-6c01-41df-9318-b0677e6fdee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:49.075824 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-cdf282c5-6c01-41df-9318-b0677e6fdee2 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:49.077025 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-cdf282c5-6c01-41df-9318-b0677e6fdee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:49.084759 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:49.125538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382bef5-b4bc-4ee2-8e1f-caaace7f2eb0 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:49.136024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382bef5-b4bc-4ee2-8e1f-caaace7f2eb0 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:49.140485 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:49.141130 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:49.141407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:49.141678 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:49.150302 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:49.151735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345623c-82b1-42f4-9ed1-f1a24ef2b88a service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:49.160633 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 538/1081] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:51.454583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f5e2-a13b-4240-9d0a-d685361b5d9d None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:51.455500 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f5e2-a13b-4240-9d0a-d685361b5d9d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:51.455786 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f5e2-a13b-4240-9d0a-d685361b5d9d None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:51.457198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:51.462752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7ee6-c423-40af-9425-3aff8b8cec36 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:51.463184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7ee6-c423-40af-9425-3aff8b8cec36 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:51.463295 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7ee6-c423-40af-9425-3aff8b8cec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:51.482283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ff0b7ee6-c423-40af-9425-3aff8b8cec36 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:51.483482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ff0b7ee6-c423-40af-9425-3aff8b8cec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:51.491338 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:51.528501 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f5e2-a13b-4240-9d0a-d685361b5d9d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:51.538855 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f5e2-a13b-4240-9d0a-d685361b5d9d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:51.542375 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:51.544080 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:51.544396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:51.544671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:51.553349 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:51.554761 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47236c6f-17d2-4fc7-ba08-c03525343526 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:51.564285 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 545/1084] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:53.852992 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ba01-b68a-4a67-8ef1-2f9694b6fd5f None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:53.853515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ba01-b68a-4a67-8ef1-2f9694b6fd5f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:53.853515 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ba01-b68a-4a67-8ef1-2f9694b6fd5f None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:53.854798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:08:53.860115 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33fda-23ed-4734-af1d-5ff3fd575265 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:53.860570 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33fda-23ed-4734-af1d-5ff3fd575265 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:53.860694 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33fda-23ed-4734-af1d-5ff3fd575265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:53.878899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-66b33fda-23ed-4734-af1d-5ff3fd575265 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:53.880087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-66b33fda-23ed-4734-af1d-5ff3fd575265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:53.888666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:08:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:53.924594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ba01-b68a-4a67-8ef1-2f9694b6fd5f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:53.935660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ba01-b68a-4a67-8ef1-2f9694b6fd5f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:53.939570 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:53.940230 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:53.940511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:53.940786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:53.950129 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:53.951546 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0046c2-d0cb-451a-be04-7a94b0cffff3 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:53.960511 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 541/1087] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:08:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:28.667735 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cbe4-ab8f-4e28-b8b7-a946b2ecb8a1 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:28.668441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cbe4-ab8f-4e28-b8b7-a946b2ecb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:28.668441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cbe4-ab8f-4e28-b8b7-a946b2ecb8a1 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:28.669723 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 547/1088] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:28.674868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158847d-2c75-4b18-b38d-83543a3811fd None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:28.675312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158847d-2c75-4b18-b38d-83543a3811fd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:28.675423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158847d-2c75-4b18-b38d-83543a3811fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:28.693320 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4158847d-2c75-4b18-b38d-83543a3811fd None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:28.694437 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4158847d-2c75-4b18-b38d-83543a3811fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:28.702743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 542/1089] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:28.751731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaef5-cec7-453c-a91e-c90833491af4 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:28.752021 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaef5-cec7-453c-a91e-c90833491af4 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:28.752339 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaef5-cec7-453c-a91e-c90833491af4 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:28.753693 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 548/1090] 10.222.0.71 () {54 vars in 962 bytes} [Thu May 12 07:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:28.758470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac87d-59ca-43d3-abdf-79f58201f90d None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:28.758765 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac87d-59ca-43d3-abdf-79f58201f90d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:28.759052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac87d-59ca-43d3-abdf-79f58201f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:28.777480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-0d4ac87d-59ca-43d3-abdf-79f58201f90d None None] MFA Rules not processed for user `3c9ac81291744cc1aca09035350296c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:28.778665 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-0d4ac87d-59ca-43d3-abdf-79f58201f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:28.785071 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 543/1091] 10.222.0.71 () {58 vars in 1059 bytes} [Thu May 12 07:09:28 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:28.792642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aaef5-cec7-453c-a91e-c90833491af4 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:28.806900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aaef5-cec7-453c-a91e-c90833491af4 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:28.811348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9ac81291744cc1aca09035350296c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:28.811987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:28.812296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:28.812578 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:28.821717 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:28.823808 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad409-db7d-4ff0-b55e-3ce2533a4e20 service glance] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:28.833223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 549/1092] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:31.225854 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4747c7-8924-44aa-aeaf-8a2481c74e60 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.226418 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4747c7-8924-44aa-aeaf-8a2481c74e60 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.226418 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4747c7-8924-44aa-aeaf-8a2481c74e60 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.227771 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 544/1093] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:31.233062 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e96c-70ae-4af8-b226-a417c6722b8f None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.233803 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e96c-70ae-4af8-b226-a417c6722b8f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.234084 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e96c-70ae-4af8-b226-a417c6722b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.251436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-bc06e96c-70ae-4af8-b226-a417c6722b8f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:31.252642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-bc06e96c-70ae-4af8-b226-a417c6722b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:31.260192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 550/1094] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:31.284940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4747c7-8924-44aa-aeaf-8a2481c74e60 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:31.297225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4747c7-8924-44aa-aeaf-8a2481c74e60 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:31.301833 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:31.302477 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.302757 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.303044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.303862 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:31.305608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:09:31.305608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:09:31.305608 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:09:31.306806 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88648-4d4d-4f28-a934-9e4e390a93b8 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:31.324930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 545/1095] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 12 07:09:31 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:09:33.642254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918b6-57f7-4700-bbcb-c1a3b6d9fc96 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:33.642830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918b6-57f7-4700-bbcb-c1a3b6d9fc96 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:33.642830 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918b6-57f7-4700-bbcb-c1a3b6d9fc96 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:33.644204 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 551/1096] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:09:33.649622 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acfb75-fcc4-461d-b992-fca372467c13 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:33.650011 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acfb75-fcc4-461d-b992-fca372467c13 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:33.650191 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acfb75-fcc4-461d-b992-fca372467c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:33.668940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-67acfb75-fcc4-461d-b992-fca372467c13 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:33.670142 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-67acfb75-fcc4-461d-b992-fca372467c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:33.677944 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 546/1097] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:33.722568 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918b6-57f7-4700-bbcb-c1a3b6d9fc96 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:33.735615 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918b6-57f7-4700-bbcb-c1a3b6d9fc96 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:33.740434 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:33.741053 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:33.741332 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:33.741605 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:33.749320 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:33.750873 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2c69d-be30-45b7-8cfe-96bae592e23a service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:33.759805 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 552/1098] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:36.286580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee7c6-3fc7-4d5e-b309-e3fa5ba7e1db None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:36.287116 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee7c6-3fc7-4d5e-b309-e3fa5ba7e1db None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:36.287116 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee7c6-3fc7-4d5e-b309-e3fa5ba7e1db None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:36.288521 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 547/1099] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:36.294017 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b959-6adf-4464-866c-736f87f81cc2 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:36.294440 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b959-6adf-4464-866c-736f87f81cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:36.294575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b959-6adf-4464-866c-736f87f81cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:36.313136 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-5be4b959-6adf-4464-866c-736f87f81cc2 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:36.314361 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-5be4b959-6adf-4464-866c-736f87f81cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:36.322213 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 553/1100] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:36.359775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee7c6-3fc7-4d5e-b309-e3fa5ba7e1db None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:36.371013 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee7c6-3fc7-4d5e-b309-e3fa5ba7e1db None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:36.374594 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:36.375223 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:36.375503 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:36.375811 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:36.384420 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:36.386805 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58497e9-5a2c-4ac6-9569-38d1348c9fdc service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:36.395763 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 548/1101] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:38.743143 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b13c-8ebc-4f10-86a1-84738ccaf24d None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:38.743677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b13c-8ebc-4f10-86a1-84738ccaf24d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:38.743677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b13c-8ebc-4f10-86a1-84738ccaf24d None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:38.745132 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 554/1102] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:38.750457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319280-c5b7-46ca-ac59-1298ee479bfb None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:38.750923 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319280-c5b7-46ca-ac59-1298ee479bfb None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:38.751054 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319280-c5b7-46ca-ac59-1298ee479bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:38.769268 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a6319280-c5b7-46ca-ac59-1298ee479bfb None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:38.770455 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a6319280-c5b7-46ca-ac59-1298ee479bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:38.778892 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 549/1103] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:38.817585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b13c-8ebc-4f10-86a1-84738ccaf24d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:38.828627 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b13c-8ebc-4f10-86a1-84738ccaf24d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:38.832131 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:38.832839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:38.833124 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:38.833435 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:38.843029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:38.844495 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052361-8d68-436d-9f74-b9b96b3fec5f service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:38.853899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 555/1104] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:41.344320 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1aaf-97fc-4563-b595-cd4b5a514b6b None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:41.344859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1aaf-97fc-4563-b595-cd4b5a514b6b None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:41.344859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1aaf-97fc-4563-b595-cd4b5a514b6b None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:41.346473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 550/1105] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:41.351702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fdfd-cc93-44cb-b493-48b9df28ba69 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:41.352142 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fdfd-cc93-44cb-b493-48b9df28ba69 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:41.352312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fdfd-cc93-44cb-b493-48b9df28ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:41.370646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-53e5fdfd-cc93-44cb-b493-48b9df28ba69 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:41.371924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-53e5fdfd-cc93-44cb-b493-48b9df28ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:41.380267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 556/1106] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:41.422463 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1aaf-97fc-4563-b595-cd4b5a514b6b None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:41.433679 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1aaf-97fc-4563-b595-cd4b5a514b6b None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:41.437253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:41.437893 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:41.438174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:41.438451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:41.448901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:41.450323 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba23eb-f301-4083-b662-4c572b581219 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:41.459638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 551/1107] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:43.939478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6306a-3a38-4667-a76e-07c405126115 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:43.940019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6306a-3a38-4667-a76e-07c405126115 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:43.940019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6306a-3a38-4667-a76e-07c405126115 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:43.941416 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 557/1108] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 12 07:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:09:43.946675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4fe9-e1f0-4170-85f5-5f2f14713e11 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:43.947085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4fe9-e1f0-4170-85f5-5f2f14713e11 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:43.947234 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4fe9-e1f0-4170-85f5-5f2f14713e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:43.964790 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-241a4fe9-e1f0-4170-85f5-5f2f14713e11 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:43.965977 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-241a4fe9-e1f0-4170-85f5-5f2f14713e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:43.973959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 552/1109] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 12 07:09:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:44.013957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6306a-3a38-4667-a76e-07c405126115 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:44.024350 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6306a-3a38-4667-a76e-07c405126115 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:44.027946 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:44.028613 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:44.028900 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:44.029178 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:44.037753 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:44.039180 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c350-5cfa-4a97-bbd2-8b44b9a59b68 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:44.049095 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 558/1110] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:09:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:11:32.815907 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:32.816590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:32.816590 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:32.834405 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:11:32.835634 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:32.843433 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 553/1111] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:11:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:11:32.852962 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:32.853839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:32.854016 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:32.872296 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:11:32.873469 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:32.881153 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 559/1112] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:11:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:11:32.886471 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:32.895825 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349405-6fdc-47db-a170-90693789fd11 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:32.900524 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:32.901175 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:32.901460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:32.901743 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:32.902460 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:11:32.902768 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:32.903784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:32.903784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:11:32.903784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:11:32.904692 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:32.915868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 554/1113] 10.222.0.71 () {58 vars in 1152 bytes} [Thu May 12 07:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:11:32.923973 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:32.933482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5970dbc-0433-42b4-8f92-82f828a644de None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:32.937995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:32.938635 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:32.938916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:32.939193 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:32.939874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:32.941705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:32.941705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:11:32.941705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:11:32.942893 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:32.968483 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 560/1114] 10.222.0.71 () {60 vars in 1152 bytes} [Thu May 12 07:11:32 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:11:32.973025 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:32.983237 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86addd3a-a3cd-46d7-bfae-316b35be0018 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.036745 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.037410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.037690 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.037966 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.038680 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.039682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:33.039682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:11:33.039682 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:11:33.040914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.059830 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 555/1115] 10.222.0.71 () {60 vars in 1143 bytes} [Thu May 12 07:11:32 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:11:33.064190 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.075478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ec018-c01b-4a3a-be43-9971a6028cfd admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.080422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.081069 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.081348 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.081625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.082464 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.083477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:33.083477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:11:33.083477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:11:33.084376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.097617 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 561/1116] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:11:33.102036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.111562 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c78c-068e-47a9-867f-4baaa68deb42 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.117448 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.118419 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.118738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.119123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.119829 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.120967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:33.120967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:11:33.120967 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:11:33.122050 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288a8be-0b63-428b-a421-618be5348749 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.137716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 556/1117] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:11:33.141907 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.151650 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b9f1-e198-4b95-be5c-0a8ecdb72b30 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.156333 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.157205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.157488 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.157768 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] PATH_INFO: `/v3/projects/eb1524297b654c84b7812fad7fa8eb88/users/1b394ddb4b984e91bbaa5e67215031fb/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.173042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1524297b654c84b7812fad7fa8eb88, user_id=1b394ddb4b984e91bbaa5e67215031fb, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.174065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:33.174065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:11:33.174065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:11:33.175998 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c0fc-2f65-4036-a28e-bb751657ae50 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.190155 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 562/1118] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:11:33 2022] PUT /identity/v3/projects/eb1524297b654c84b7812fad7fa8eb88/users/1b394ddb4b984e91bbaa5e67215031fb/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:11:33.201296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5089d6-51a9-4079-9862-744ec3fecf17 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.201585 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5089d6-51a9-4079-9862-744ec3fecf17 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.201861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5089d6-51a9-4079-9862-744ec3fecf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.227200 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-db5089d6-51a9-4079-9862-744ec3fecf17 None None] MFA Rules not processed for user `1b394ddb4b984e91bbaa5e67215031fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:11:33.228402 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-db5089d6-51a9-4079-9862-744ec3fecf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:33.287182 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 557/1119] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:11:33 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:11:33.300952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab35f-a88c-43d3-b144-1a5479f3f2d5 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.301246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab35f-a88c-43d3-b144-1a5479f3f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.301528 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab35f-a88c-43d3-b144-1a5479f3f2d5 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.302890 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 563/1120] 10.222.0.71 () {54 vars in 963 bytes} [Thu May 12 07:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:11:33.308480 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12183f-5c8e-4da0-8f08-30dad733489f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.308774 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12183f-5c8e-4da0-8f08-30dad733489f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.309056 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12183f-5c8e-4da0-8f08-30dad733489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.326639 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-be12183f-5c8e-4da0-8f08-30dad733489f None None] MFA Rules not processed for user `395edc9a3a5c4dc2b4dcc4f2a4d5e330`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:11:33.327751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-be12183f-5c8e-4da0-8f08-30dad733489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:33.376227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 558/1121] 10.222.0.71 () {58 vars in 1060 bytes} [Thu May 12 07:11:33 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:11:33.383591 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dab35f-a88c-43d3-b144-1a5479f3f2d5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.393970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dab35f-a88c-43d3-b144-1a5479f3f2d5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.398515 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395edc9a3a5c4dc2b4dcc4f2a4d5e330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.399308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.399648 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.400019 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.408746 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.410158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.419396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 564/1122] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:11:33 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:11:33.458637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c466-9c4d-48f4-a52d-9b884f440548 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.458929 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c466-9c4d-48f4-a52d-9b884f440548 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.459208 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c466-9c4d-48f4-a52d-9b884f440548 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.461271 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 559/1123] 10.222.0.71 () {52 vars in 829 bytes} [Thu May 12 07:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:11:33.465004 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.526432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f1693-7359-4bf9-94b3-a5c0b01ed432 service cinder] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.531200 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.532030 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.532336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.532609 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] PATH_INFO: `/v3/users/1b394ddb4b984e91bbaa5e67215031fb` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.533791 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b394ddb4b984e91bbaa5e67215031fb)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.534798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:33.534798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:11:33.534798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:11:33.535992 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.604357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b394ddb4b984e91bbaa5e67215031fb'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:33.613683 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b394ddb4b984e91bbaa5e67215031fb'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:33.614356 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b394ddb4b984e91bbaa5e67215031fb'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:33.632789 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b394ddb4b984e91bbaa5e67215031fb'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:33.633531 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b394ddb4b984e91bbaa5e67215031fb'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:33.651376 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 565/1124] 10.222.0.71 () {58 vars in 1223 bytes} [Thu May 12 07:11:33 2022] DELETE /identity/v3/users/1b394ddb4b984e91bbaa5e67215031fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:11:33.655798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.656082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.656383 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.673800 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:11:33.674972 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:33.730705 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 560/1125] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:11:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:11:33.740337 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:33.741858 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:33.804731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965be78-3735-4bd1-9b37-b85ea3e60ccb admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:33.808275 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:33.808906 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:33.809184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:33.809452 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:33.818086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:33.820106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d443-020b-4930-afd3-24d6730667da service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:33.829099 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 566/1126] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:11:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:11:34.148222 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:11:34.148736 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:11:34.160113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc172b34-82ac-45a7-ad3c-5f6ee48593c9 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:11:34.165335 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:11:34.166192 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:11:34.166473 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:11:34.166746 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] PATH_INFO: `/v3/projects/eb1524297b654c84b7812fad7fa8eb88` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:11:34.167940 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1524297b654c84b7812fad7fa8eb88)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:11:34.169001 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:11:34.169001 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:11:34.169001 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:11:34.170148 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:11:34.232710 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1524297b654c84b7812fad7fa8eb88', 'request_id': 'req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:34.246438 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1524297b654c84b7812fad7fa8eb88', 'request_id': 'req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:34.255898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1524297b654c84b7812fad7fa8eb88', 'request_id': 'req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:34.267036 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] The token cache is being invalidate because project eb1524297b654c84b7812fad7fa8eb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:11:34.267318 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:34.268012 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-0f1fe36a-40fd-47a2-8e13-bdb7cb9497df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:11:34.269560 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 561/1127] 10.222.0.71 () {58 vars in 1232 bytes} [Thu May 12 07:11:34 2022] DELETE /identity/v3/projects/eb1524297b654c84b7812fad7fa8eb88 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:12:57.926636 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:57.927221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:57.927221 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:57.928586 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:12:57.933330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb558f-8787-4c45-abb7-36082de322cd None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:57.933725 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb558f-8787-4c45-abb7-36082de322cd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:57.933896 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb558f-8787-4c45-abb7-36082de322cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:58.002607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d3fb558f-8787-4c45-abb7-36082de322cd None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:12:58.003819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d3fb558f-8787-4c45-abb7-36082de322cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:58.092606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:12:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:12:58.268546 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:58.270144 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:58.357261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4e1c3-f64f-4765-9102-4d2b8c433210 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:58.363052 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786263d-e106-4114-8613-464a87164046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:58.363695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786263d-e106-4114-8613-464a87164046 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:58.363982 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786263d-e106-4114-8613-464a87164046 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:58.364295 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786263d-e106-4114-8613-464a87164046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:58.372291 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786263d-e106-4114-8613-464a87164046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:58.373997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786263d-e106-4114-8613-464a87164046 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:58.383168 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 568/1130] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:12:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:12:59.306762 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ddcb0-2de7-4c85-9ebc-cc54c2b33acd None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:59.307331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ddcb0-2de7-4c85-9ebc-cc54c2b33acd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:59.307331 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ddcb0-2de7-4c85-9ebc-cc54c2b33acd None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:59.308685 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:12:59.314214 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdc9c9-449f-4fb2-9538-90312fd53a8f None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:59.314642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdc9c9-449f-4fb2-9538-90312fd53a8f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:59.314798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdc9c9-449f-4fb2-9538-90312fd53a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:59.333173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-dacdc9c9-449f-4fb2-9538-90312fd53a8f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:12:59.334352 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-dacdc9c9-449f-4fb2-9538-90312fd53a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:59.342224 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:12:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:12:59.498488 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ddcb0-2de7-4c85-9ebc-cc54c2b33acd None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:59.512400 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ddcb0-2de7-4c85-9ebc-cc54c2b33acd None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:59.517539 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:59.518173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:59.518456 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:59.518735 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:59.526629 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:59.528256 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14d44-122b-4c1e-bc46-d42651cf8694 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:59.537530 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 564/1133] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:12:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:02.896864 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a406af1-e724-4b96-b0d6-2354b1700954 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:02.897422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a406af1-e724-4b96-b0d6-2354b1700954 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:02.897422 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a406af1-e724-4b96-b0d6-2354b1700954 None None] PATH_INFO: `/v3` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:02.898741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 570/1134] 10.222.0.69 () {54 vars in 925 bytes} [Thu May 12 07:13:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:13:02.905044 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d828d-0b45-41c0-832c-e0a179680cb0 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:02.906020 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d828d-0b45-41c0-832c-e0a179680cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:02.906209 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d828d-0b45-41c0-832c-e0a179680cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:02.933500 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4c9d828d-0b45-41c0-832c-e0a179680cb0 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:02.934683 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4c9d828d-0b45-41c0-832c-e0a179680cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:02.995299 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 565/1135] 10.222.0.69 () {58 vars in 1015 bytes} [Thu May 12 07:13:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:10.867043 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c670e-33e9-4ebf-8dc5-2b3b904e91f9 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:10.867575 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c670e-33e9-4ebf-8dc5-2b3b904e91f9 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:10.867671 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c670e-33e9-4ebf-8dc5-2b3b904e91f9 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:10.869078 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:10.874025 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13e23-5be2-4438-909b-a327c1dc1f07 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:10.874431 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13e23-5be2-4438-909b-a327c1dc1f07 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:10.874597 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13e23-5be2-4438-909b-a327c1dc1f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:10.894721 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-cdd13e23-5be2-4438-909b-a327c1dc1f07 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:10.896073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-cdd13e23-5be2-4438-909b-a327c1dc1f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:10.903925 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:13:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:11.063747 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c670e-33e9-4ebf-8dc5-2b3b904e91f9 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:11.076785 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c670e-33e9-4ebf-8dc5-2b3b904e91f9 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:11.081874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:11.082498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:11.082779 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:11.083066 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:11.090894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:11.092517 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d32d8-eabe-4ef0-abef-49f63bb29f60 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:11.103303 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 572/1138] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:12.015732 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2770b-fdda-4b63-9449-ece1ac1ecab8 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.016296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2770b-fdda-4b63-9449-ece1ac1ecab8 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.016404 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2770b-fdda-4b63-9449-ece1ac1ecab8 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.017776 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 07:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:12.022833 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746c0d-d68c-4d29-add6-40dbf56e0ec3 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.023252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746c0d-d68c-4d29-add6-40dbf56e0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.023392 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746c0d-d68c-4d29-add6-40dbf56e0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.041890 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-93746c0d-d68c-4d29-add6-40dbf56e0ec3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:12.043065 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-93746c0d-d68c-4d29-add6-40dbf56e0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:12.052321 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 07:13:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:12.060029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0249db-ccd9-480a-bed4-f421d337a6dd None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.060508 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0249db-ccd9-480a-bed4-f421d337a6dd None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.060863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0249db-ccd9-480a-bed4-f421d337a6dd None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.062410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 568/1141] 10.222.0.71 () {54 vars in 960 bytes} [Thu May 12 07:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:12.067845 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.068154 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.068441 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.087957 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:12.089287 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:12.098874 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 574/1142] 10.222.0.71 () {58 vars in 1057 bytes} [Thu May 12 07:13:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:13:12.106389 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0249db-ccd9-480a-bed4-f421d337a6dd None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:12.120363 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0249db-ccd9-480a-bed4-f421d337a6dd None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:12.126103 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81c7999cb2445fca81343d207963903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:12.126749 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.127030 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.127309 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.135777 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:12.137408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac186db-0ae9-4ec9-be40-9af53bdeb3e5 service placement] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:12.147121 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 569/1143] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:13:12.210223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:12.221819 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec25d5-4d88-41fa-84c8-59f4dbb53e85 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:12.227068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:12.227695 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:12.227972 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:12.228273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:12.237146 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:12.238769 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a033e8d-c81e-4217-ba0f-d285f320f1d7 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:12.248067 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 575/1144] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:16.541584 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:16.542452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:16.542452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:16.543497 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:16.549151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715d24d-7566-4141-ba68-190322154aa6 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:16.549763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715d24d-7566-4141-ba68-190322154aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:16.549763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715d24d-7566-4141-ba68-190322154aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:16.568172 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-7715d24d-7566-4141-ba68-190322154aa6 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:16.569495 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-7715d24d-7566-4141-ba68-190322154aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:16.577325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:13:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:16.615881 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:16.617626 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:16.674732 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248c0c-c0f0-49d0-b08c-e9bcabb1ad43 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:16.678288 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:16.679076 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:16.679359 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:16.679641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:16.689566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:16.690934 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c96f-3333-4af0-b6d6-e191113753ff service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:16.702273 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 571/1147] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:19.010851 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8818b-d171-4be4-bffc-7fb49c409ab7 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:19.011371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8818b-d171-4be4-bffc-7fb49c409ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:19.011371 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8818b-d171-4be4-bffc-7fb49c409ab7 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:19.012731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:19.017876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b26-50cc-4f44-bf45-80756da87949 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:19.018310 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b26-50cc-4f44-bf45-80756da87949 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:19.018415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b26-50cc-4f44-bf45-80756da87949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:19.036002 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-42b60b26-50cc-4f44-bf45-80756da87949 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:19.037228 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-42b60b26-50cc-4f44-bf45-80756da87949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:19.044919 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:13:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:19.082629 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8818b-d171-4be4-bffc-7fb49c409ab7 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:19.093308 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8818b-d171-4be4-bffc-7fb49c409ab7 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:19.097273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:19.097904 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:19.098184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:19.098456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:19.107106 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:19.108576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aee5b-5ec4-406b-8938-9ec819af7189 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:19.118355 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 578/1150] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:23.119816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:23.120398 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:23.120398 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:23.121820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:23.127571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f3bf-29bf-40d0-8a13-57e4b2566a45 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:23.128027 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f3bf-29bf-40d0-8a13-57e4b2566a45 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:23.128170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f3bf-29bf-40d0-8a13-57e4b2566a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:23.145574 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-e692f3bf-29bf-40d0-8a13-57e4b2566a45 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:23.146794 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-e692f3bf-29bf-40d0-8a13-57e4b2566a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:23.154459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:13:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:13:23.441252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:23.443226 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:23.516102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755356a-949d-4cbc-8f38-0b27e76a9c50 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:23.519663 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395edc9a3a5c4dc2b4dcc4f2a4d5e330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:23.520329 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:23.520612 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:23.520886 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:23.529670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:23.531637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f072-fe30-4e9b-ad6b-be7ab88a4ad3 service cinder] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:23.540821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 574/1153] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:25.947108 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:25.947667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:25.947667 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:25.949070 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 07:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:13:25.954948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2bb1-4322-4640-a092-d8df0353aa3f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:25.955377 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2bb1-4322-4640-a092-d8df0353aa3f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:25.955507 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2bb1-4322-4640-a092-d8df0353aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:25.973670 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-d0eb2bb1-4322-4640-a092-d8df0353aa3f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:25.974873 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-d0eb2bb1-4322-4640-a092-d8df0353aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:25.982880 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 07:13:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:26.254938 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:26.256653 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:26.270136 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ada4a-f498-4969-b3d3-7d24f0b001c0 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:26.273710 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395edc9a3a5c4dc2b4dcc4f2a4d5e330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:26.274342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:26.274618 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:26.274886 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:26.283571 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:26.285010 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e928-d8c2-4932-ad2c-dc573fab4778 service cinder] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:26.293952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 581/1156] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:13:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:14:47.627029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4576e-ce8c-49aa-8790-bd282d6f951f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.627660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4576e-ce8c-49aa-8790-bd282d6f951f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.627660 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4576e-ce8c-49aa-8790-bd282d6f951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.634503 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418a4-9fc2-4c09-929f-013b213b89ea None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.634955 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418a4-9fc2-4c09-929f-013b213b89ea None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.635056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418a4-9fc2-4c09-929f-013b213b89ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.647524 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-7eb4576e-ce8c-49aa-8790-bd282d6f951f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:47.648779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-7eb4576e-ce8c-49aa-8790-bd282d6f951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:47.653539 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-c79418a4-9fc2-4c09-929f-013b213b89ea None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:47.654702 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-c79418a4-9fc2-4c09-929f-013b213b89ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:47.657535 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 576/1157] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:14:47.663191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 582/1158] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:14:47.666739 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.667030 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.667317 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.672569 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.672956 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.673247 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.685471 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:47.686796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:47.691281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:47.692521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:47.694885 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 577/1159] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:14:47.699580 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.701035 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 583/1160] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:14:47.706646 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.709930 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f349-e31e-40f1-8d7b-d83834d8f78f None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.714647 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.715315 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.715582 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc37b50-935e-426c-a54e-193ec0937e8e None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.715694 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.715865 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] PATH_INFO: `/v3/domains` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.716632 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:14:47.716947 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.719174 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.721267 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.721917 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.722201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.722478 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.723199 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:14:47.723507 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.724544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 07:14:47.724544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:14:47.724544 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:14:47.725427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.736219 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 578/1161] 10.222.0.71 () {58 vars in 1152 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:14:47.737979 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 584/1162] 10.222.0.71 () {58 vars in 1152 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:14:47.740217 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.745923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.750959 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd359e-b375-45c1-8e51-6d5cea30d210 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.755650 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.756344 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.756631 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.756886 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f20a-2bd9-4a2c-82df-36a06e2d5a9b admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.757001 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.757593 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.758611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:14:47.758611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:14:47.758611 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:14:47.759796 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.761497 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.762173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.762453 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.762724 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.763427 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.766120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.796425 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 579/1163] 10.222.0.71 () {60 vars in 1152 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:14:47.800482 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.803585 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 585/1164] 10.222.0.71 () {60 vars in 1152 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:14:47.804413 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.861093 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acd33-0f6a-45b6-817d-53baa03f7714 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.865707 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.866242 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d748e-4b5e-4b22-81ef-5683548f2496 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.866395 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.866643 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.866918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.867628 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.869552 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.871011 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.871668 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.871952 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.872258 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.872942 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.873940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:14:47.873940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:14:47.873940 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:14:47.876272 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.891291 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 580/1165] 10.222.0.71 () {60 vars in 1143 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:14:47.895399 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.899997 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 586/1166] 10.222.0.71 () {60 vars in 1143 bytes} [Thu May 12 07:14:47 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:14:47.900922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.909474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28e1f-b946-42a6-9c4f-e59b5d3ffe88 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.911088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0918-8e72-43b2-9108-6860a09b6cf3 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.914122 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.914779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.915064 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.915343 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.915796 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.916062 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.916588 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.916871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.917147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.917723 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.917887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.919487 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.928798 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 581/1167] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:14:47.932151 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 587/1168] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:14:47.933607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.933739 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.943298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834db4-18ac-4620-a9a6-aabe8316deea admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.943642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a4e7-e24d-4bca-8b62-73d07d3f9923 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.948073 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.948436 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.948755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.949041 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.949150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.949319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.949423 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.949605 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.950032 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.950312 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.951621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.951894 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:47.962309 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 588/1170] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:14:47.962451 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 582/1170] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:14:47.966167 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.966328 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:47.976496 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d213-33d2-4ae6-91de-8e3d0ceb36f4 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.976659 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99a42-68e3-41ab-a0f5-c48eb113b692 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:47.981137 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.981279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:47.981987 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.982095 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:47.982263 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.982366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:47.982538 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] PATH_INFO: `/v3/projects/7d6e165d394346caa2debaca59c237df/users/8090215141204fa78dc82c054881a716/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.982642 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] PATH_INFO: `/v3/projects/9c4fbb7f5a4a43849dd0741818cea640/users/da4a363fd90b41f7973fbb95b77bc592/roles/b781ae4ae48046a1a9650d001916004e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:47.996898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6e165d394346caa2debaca59c237df, user_id=8090215141204fa78dc82c054881a716, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.997229 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4fbb7f5a4a43849dd0741818cea640, user_id=da4a363fd90b41f7973fbb95b77bc592, role_id=b781ae4ae48046a1a9650d001916004e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:47.997962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:14:47.997962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:14:47.997962 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:14:47.999884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88d3c5-01db-4fcb-8b43-fb036312d595 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:48.000407 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaf69a-d2d0-4200-bcba-a25532ffa960 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:48.013479 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 583/1171] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:47 2022] PUT /identity/v3/projects/7d6e165d394346caa2debaca59c237df/users/8090215141204fa78dc82c054881a716/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:14:48.013812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 589/1172] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:47 2022] PUT /identity/v3/projects/9c4fbb7f5a4a43849dd0741818cea640/users/da4a363fd90b41f7973fbb95b77bc592/roles/b781ae4ae48046a1a9650d001916004e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:14:48.018793 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:48.018959 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:48.019077 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:48.019179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:48.019345 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:48.019474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:48.036072 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:48.036828 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] MFA Rules not processed for user `1ed0de300758400388e11ebad1cc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:48.037306 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:48.037997 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:48.098031 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 590/1173] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:14:48.099820 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 584/1174] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:14:48.108150 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:48.111298 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:48.112720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:48.163521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84d9ea-53a6-4e3c-9547-f3ead289d0e5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:48.167315 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:48.167963 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:48.168279 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:48.168677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:48.178456 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:48.179882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86a7b-342a-4a13-bedb-2792bfbee3fd service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:48.180452 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5f21-e43d-4198-9db7-dbbbac8afab3 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:48.184042 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:48.184716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:48.185000 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:48.185278 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:48.189380 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 591/1175] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:14:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:14:48.194920 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:48.196443 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:48.206786 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 585/1176] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:14:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:14:53.315756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.316691 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.317158 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.368259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:53.370185 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:53.466504 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 592/1177] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:53 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:14:53.473186 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.488411 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281a2f9-cb88-4134-b727-b0d356f92ae2 service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:53.496380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:53.497316 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.497803 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.499885 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] PATH_INFO: `/v3/projects` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.500913 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:53.503113 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:53.538442 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 586/1178] 10.222.0.71 () {60 vars in 1152 bytes} [Thu May 12 07:14:53 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:14:53.542976 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.558592 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9664-0299-462d-adae-bdecf6015e05 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:53.666869 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:53.667871 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.668362 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.668844 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] PATH_INFO: `/v3/users` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.670098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:53.672908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:53.704720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 593/1179] 10.222.0.71 () {60 vars in 1143 bytes} [Thu May 12 07:14:53 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:14:53.706051 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.721876 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ede6-0598-4c58-a537-89a732443832 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:53.732973 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:53.734183 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.734816 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.735224 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.736794 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:53.738558 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:53.753253 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 587/1180] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:14:53.757412 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.785310 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd14ba4-0a2b-41e3-89fd-6ad9954d8145 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:53.792673 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:53.794424 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.794868 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.795217 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] PATH_INFO: `/v3/projects/c551385617cb4ed9878e4bb5092b4532/users/8840810a2db14b67a4191fb3a96dbad0/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.821205 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c551385617cb4ed9878e4bb5092b4532, user_id=8840810a2db14b67a4191fb3a96dbad0, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:53.824246 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:53.848293 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 594/1181] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:53 2022] PUT /identity/v3/projects/c551385617cb4ed9878e4bb5092b4532/users/8840810a2db14b67a4191fb3a96dbad0/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:14:53.852057 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.868457 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cd2d-2abb-46eb-8953-de96848991f4 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:53.969170 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:53.970225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:53.970598 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:53.970950 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] PATH_INFO: `/v3/roles` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:53.971825 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:53.973570 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c55d6-045b-4d8f-9d21-8aa026a5d092 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:53.985863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 588/1182] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:14:53.988939 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:53.999357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ea17-e24e-4438-9c4e-380c61bf2f8c admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.004732 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.005756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.006046 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.006322 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] PATH_INFO: `/v3/projects/c551385617cb4ed9878e4bb5092b4532/users/8840810a2db14b67a4191fb3a96dbad0/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.008366 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c551385617cb4ed9878e4bb5092b4532, user_id=8840810a2db14b67a4191fb3a96dbad0, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.011396 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.027113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 595/1183] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:53 2022] PUT /identity/v3/projects/c551385617cb4ed9878e4bb5092b4532/users/8840810a2db14b67a4191fb3a96dbad0/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:14:54.029615 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.030094 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.030998 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.059948 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] MFA Rules not processed for user `8090215141204fa78dc82c054881a716`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:14:54.062024 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:54.144312 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 589/1184] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:14:54 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:14:54.149963 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.217553 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b69ca-79ee-4738-a3e1-e77791f063a7 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.241466 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.243510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.243831 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.244112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.244844 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.246763 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.288730 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 596/1185] 10.222.0.71 () {60 vars in 1152 bytes} [Thu May 12 07:14:54 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:14:54.293166 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.304465 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e083-0795-4ef9-962f-061aa04babf5 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.411027 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.411861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.412300 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.413505 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.414576 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.416607 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.451666 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 590/1186] 10.222.0.71 () {60 vars in 1143 bytes} [Thu May 12 07:14:54 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:14:54.456255 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.489494 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc181-51fd-413d-9bb8-985dd55467e7 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.512750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.513445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.513908 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.514357 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.515958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.517943 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.537091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 597/1187] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:14:54.541194 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.551621 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe43e-35e2-40e4-a012-1f1f01e890b0 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.557123 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.558401 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.558898 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.559324 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] PATH_INFO: `/v3/projects/ea9936c619074d59ab71664f90fa412e/users/f6ae292e47d34608b5839cfe71f56d12/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.581638 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9936c619074d59ab71664f90fa412e, user_id=f6ae292e47d34608b5839cfe71f56d12, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.584566 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.602172 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 591/1188] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:54 2022] PUT /identity/v3/projects/ea9936c619074d59ab71664f90fa412e/users/f6ae292e47d34608b5839cfe71f56d12/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:14:54.607328 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.620373 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103963-2224-4416-8e4d-379bf00584cb admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.694474 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.695259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.695549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.695832 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.696626 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.698256 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35c8e-e010-42f6-87b1-0fc5096aba2b admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.717660 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 598/1189] 10.222.0.71 () {58 vars in 1121 bytes} [Thu May 12 07:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:14:54.719423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:54.731831 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93dbae-2acb-40eb-9dbd-198aad5d1562 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:54.740190 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:54.741141 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:54.741487 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:54.741773 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] PATH_INFO: `/v3/projects/ea9936c619074d59ab71664f90fa412e/users/f6ae292e47d34608b5839cfe71f56d12/roles/5f4db304bc714dcca08bff34b065a8f5` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:54.743884 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9936c619074d59ab71664f90fa412e, user_id=f6ae292e47d34608b5839cfe71f56d12, role_id=5f4db304bc714dcca08bff34b065a8f5)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:54.748308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:54.781826 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 592/1190] 10.222.0.71 () {60 vars in 1482 bytes} [Thu May 12 07:14:54 2022] PUT /identity/v3/projects/ea9936c619074d59ab71664f90fa412e/users/f6ae292e47d34608b5839cfe71f56d12/roles/5f4db304bc714dcca08bff34b065a8f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:15:00.544240 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874451b-c472-4880-91fc-4b4f7d8f7906 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:00.545196 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874451b-c472-4880-91fc-4b4f7d8f7906 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:00.545705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874451b-c472-4880-91fc-4b4f7d8f7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:00.589179 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-1874451b-c472-4880-91fc-4b4f7d8f7906 None None] MFA Rules not processed for user `8840810a2db14b67a4191fb3a96dbad0`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:00.590810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1874451b-c472-4880-91fc-4b4f7d8f7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:00.724889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 599/1191] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:15:00 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:00.726041 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:00.728459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:00.815021 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cdadf-7001-4572-965d-58f0934561eb admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:00.819706 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9ac81291744cc1aca09035350296c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:00.820716 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:00.821221 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:00.821738 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:00.901143 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:00.903100 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:00.929218 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 593/1192] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:00 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:01.665887 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f13f-6635-4728-913d-380fd2beeb63 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:01.666863 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f13f-6635-4728-913d-380fd2beeb63 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:01.667311 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f13f-6635-4728-913d-380fd2beeb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:01.704741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-1af4f13f-6635-4728-913d-380fd2beeb63 None None] MFA Rules not processed for user `f6ae292e47d34608b5839cfe71f56d12`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:01.706217 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1af4f13f-6635-4728-913d-380fd2beeb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:01.811555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 600/1193] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:15:01 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:01.834565 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:01.836837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:01.856330 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d0dfd-c757-44f9-b7bd-d778988cd6d9 service glance] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:01.861755 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9ac81291744cc1aca09035350296c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:01.862814 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:01.862814 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:01.863150 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:01.939385 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:01.941812 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e582c-3e95-4fdd-bf7c-d009da718848 service glance] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:01.955923 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 594/1194] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:01 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:10.165604 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bccf-7ab5-4157-82cc-1b9c7e448206 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.166174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bccf-7ab5-4157-82cc-1b9c7e448206 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.166174 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bccf-7ab5-4157-82cc-1b9c7e448206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.184581 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-d416bccf-7ab5-4157-82cc-1b9c7e448206 None None] MFA Rules not processed for user `8090215141204fa78dc82c054881a716`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:10.185765 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d416bccf-7ab5-4157-82cc-1b9c7e448206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:10.193576 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 601/1195] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:15:10 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:10.472179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9707596-2e5a-4fa4-b5d8-b203a54fe1c4 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.472711 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9707596-2e5a-4fa4-b5d8-b203a54fe1c4 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.472801 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9707596-2e5a-4fa4-b5d8-b203a54fe1c4 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.474119 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 595/1196] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 12 07:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 07:15:10.479184 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e36b-1b1d-4d94-aca4-22837da3d140 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.479471 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e36b-1b1d-4d94-aca4-22837da3d140 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.479752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e36b-1b1d-4d94-aca4-22837da3d140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.515476 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-80c6e36b-1b1d-4d94-aca4-22837da3d140 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:10.516994 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-80c6e36b-1b1d-4d94-aca4-22837da3d140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:10.584633 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 602/1197] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 12 07:15:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:15:10.590034 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0597fe-df98-4e7f-8461-37b66edb3795 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.590324 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0597fe-df98-4e7f-8461-37b66edb3795 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.590605 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0597fe-df98-4e7f-8461-37b66edb3795 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.591946 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 596/1198] 10.222.0.71 () {54 vars in 912 bytes} [Thu May 12 07:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:10.597415 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296021-29b2-481e-b361-b83d03475253 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.597705 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296021-29b2-481e-b361-b83d03475253 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.597983 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296021-29b2-481e-b361-b83d03475253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.616201 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-92296021-29b2-481e-b361-b83d03475253 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:10.617404 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-92296021-29b2-481e-b361-b83d03475253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:10.626899 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 603/1199] 10.222.0.71 () {58 vars in 1009 bytes} [Thu May 12 07:15:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:10.638641 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0597fe-df98-4e7f-8461-37b66edb3795 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:10.651252 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0597fe-df98-4e7f-8461-37b66edb3795 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:10.655668 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9ac81291744cc1aca09035350296c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:10.656371 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:10.656662 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:10.656945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:10.667279 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:10.668720 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe081737-c247-47f5-874d-69213cf6a483 service glance] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:10.679701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 597/1200] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:11.049125 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146cac-132d-4f82-a1b5-888dfabc86b5 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.049812 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146cac-132d-4f82-a1b5-888dfabc86b5 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.050173 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146cac-132d-4f82-a1b5-888dfabc86b5 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.051924 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 604/1201] 10.222.0.71 () {54 vars in 912 bytes} [Thu May 12 07:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:11.057855 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259646a-69fc-488e-a3ec-cca5f4e7ff10 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.058153 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259646a-69fc-488e-a3ec-cca5f4e7ff10 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.058440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259646a-69fc-488e-a3ec-cca5f4e7ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.088779 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-4259646a-69fc-488e-a3ec-cca5f4e7ff10 None None] MFA Rules not processed for user `015718a382044581ba4fceb50c466ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:11.091009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4259646a-69fc-488e-a3ec-cca5f4e7ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:11.160751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 598/1202] 10.222.0.71 () {58 vars in 1009 bytes} [Thu May 12 07:15:11 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:11.172865 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146cac-132d-4f82-a1b5-888dfabc86b5 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:11.184295 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146cac-132d-4f82-a1b5-888dfabc86b5 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:11.191288 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:11.192254 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.192889 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.193327 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.204910 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:11.206862 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0cc80-6e08-4e4a-ae58-8e2a2dd22b4c service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:11.223543 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 605/1203] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:11 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:11.785037 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54125c-5e8e-4c12-a760-25aeeb44396f None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.785636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54125c-5e8e-4c12-a760-25aeeb44396f None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.785964 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54125c-5e8e-4c12-a760-25aeeb44396f None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.787469 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 599/1204] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 12 07:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:11.793669 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aca500-f68b-4dcd-88e5-46f289ac9039 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.794123 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aca500-f68b-4dcd-88e5-46f289ac9039 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.794481 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aca500-f68b-4dcd-88e5-46f289ac9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.818210 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-79aca500-f68b-4dcd-88e5-46f289ac9039 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:11.819482 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-79aca500-f68b-4dcd-88e5-46f289ac9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:11.830750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 606/1205] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 12 07:15:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:11.838110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf9d81-baa6-4357-957d-360b8e73d141 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.838110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf9d81-baa6-4357-957d-360b8e73d141 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.838110 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf9d81-baa6-4357-957d-360b8e73d141 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.840211 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 600/1206] 10.222.0.71 () {54 vars in 912 bytes} [Thu May 12 07:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:11.852577 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.852841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714474-0205-4526-9ef8-c3ee111c83a0 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.852970 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.853141 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.853752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714474-0205-4526-9ef8-c3ee111c83a0 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.854046 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714474-0205-4526-9ef8-c3ee111c83a0 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.859018 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 601/1207] 10.222.0.71 () {54 vars in 960 bytes} [Thu May 12 07:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:11.866372 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e9a2-1e69-40ea-8a45-79f0a326174d None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.867504 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e9a2-1e69-40ea-8a45-79f0a326174d None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.868167 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e9a2-1e69-40ea-8a45-79f0a326174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.906125 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:11.908764 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:11.913543 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-7708e9a2-1e69-40ea-8a45-79f0a326174d None None] MFA Rules not processed for user `d81c7999cb2445fca81343d207963903`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:11.917184 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-7708e9a2-1e69-40ea-8a45-79f0a326174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:11.928729 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 607/1208] 10.222.0.71 () {58 vars in 1009 bytes} [Thu May 12 07:15:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:11.953278 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:11.964489 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb96c-0579-4070-a347-c9fe92c43089 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:11.969941 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:11.970559 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:11.970898 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:11.971233 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:11.995913 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:11.998880 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:12.016280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 608/1209] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:15:12.026624 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 602/1210] 10.222.0.71 () {58 vars in 1057 bytes} [Thu May 12 07:15:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:12.036636 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:12.058091 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2070c9-649e-47b7-aee9-b733e6ac865f service neutron] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:12.080310 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81c7999cb2445fca81343d207963903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:12.083442 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:12.083741 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:12.084030 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:12.089021 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:12.115154 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:12.117014 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:12.140319 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 609/1211] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:25.145784 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6008-c1f4-4af1-9dc4-915a79c36437 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:25.146380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6008-c1f4-4af1-9dc4-915a79c36437 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:25.146380 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6008-c1f4-4af1-9dc4-915a79c36437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:25.164025 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-050a6008-c1f4-4af1-9dc4-915a79c36437 None None] MFA Rules not processed for user `015718a382044581ba4fceb50c466ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:25.165266 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-050a6008-c1f4-4af1-9dc4-915a79c36437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:25.172610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 603/1212] 10.222.0.69 () {58 vars in 1015 bytes} [Thu May 12 07:15:25 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:15:25.199522 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:25.209268 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077715-fd0e-40ad-86cc-7baa2596feb5 service placement] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:25.213192 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:25.213839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:25.214170 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:25.214448 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:25.229610 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:25.231088 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df76de7-5f1d-446d-8f5e-8d445e1f8459 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:25.241665 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 610/1213] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:25 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:26.038837 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a211-5845-4041-bc8c-bb946b90d622 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:26.039922 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a211-5845-4041-bc8c-bb946b90d622 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:26.040263 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a211-5845-4041-bc8c-bb946b90d622 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:26.041834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 604/1214] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:26.051583 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4935f0-f8d2-460e-8af5-708f2f470c50 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:26.053113 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4935f0-f8d2-460e-8af5-708f2f470c50 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:26.053599 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4935f0-f8d2-460e-8af5-708f2f470c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:26.080756 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-4a4935f0-f8d2-460e-8af5-708f2f470c50 None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:26.082042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-4a4935f0-f8d2-460e-8af5-708f2f470c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:26.099810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 611/1215] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:15:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:26.144842 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898a211-5845-4041-bc8c-bb946b90d622 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:26.164358 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898a211-5845-4041-bc8c-bb946b90d622 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:26.169799 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:26.171297 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:26.171834 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:26.172525 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:26.183821 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:26.188459 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c9a5b-ba1c-4671-952d-622ac9a34cd0 service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:26.203945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 605/1216] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:33.206752 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d5cd-6056-4f89-ae43-052a4fc0ac49 None None] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:33.207367 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d5cd-6056-4f89-ae43-052a4fc0ac49 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:33.207367 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d5cd-6056-4f89-ae43-052a4fc0ac49 None None] PATH_INFO: `/` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:33.208882 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 612/1217] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:15:33.221859 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:33.222370 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:33.222489 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:33.244760 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:33.246009 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:33.257173 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 606/1218] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:15:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:33.275823 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d5cd-6056-4f89-ae43-052a4fc0ac49 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:33.297390 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d5cd-6056-4f89-ae43-052a4fc0ac49 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:33.302273 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:33.302906 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:33.303188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:33.303459 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:33.312188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:33.314286 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd035c-8ee3-4a80-b57a-e6ce76c22200 service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:33.325760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 613/1219] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:44.532819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:44.541742 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c39d5-e44f-4c56-971d-87a96e9904ff None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:44.545534 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:44.546122 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:44.546407 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:44.546685 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:44.555467 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:44.556932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949333a7-abd0-498e-844e-116ce5bd2128 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:44.568282 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 607/1220] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:15:44 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:59.693061 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:59.693596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:59.693596 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:59.711056 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:59.712290 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:59.719611 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 614/1221] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:15:59 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:16:00.027357 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ba3-5250-4fe2-9a8e-a40c409f2c6a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:00.027936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ba3-5250-4fe2-9a8e-a40c409f2c6a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:00.027936 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ba3-5250-4fe2-9a8e-a40c409f2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:00.046856 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-f4a28ba3-5250-4fe2-9a8e-a40c409f2c6a None None] MFA Rules not processed for user `015718a382044581ba4fceb50c466ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:16:00.048049 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-f4a28ba3-5250-4fe2-9a8e-a40c409f2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:00.054602 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 608/1222] 10.222.0.71 () {58 vars in 1009 bytes} [Thu May 12 07:16:00 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:16:00.066314 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:00.075556 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095b4b-70d8-4d17-866e-c921cc849724 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:00.079342 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:00.079995 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:00.080387 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:00.080666 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:00.088006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:00.089498 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645347-e2e1-46cc-b4fd-c0e242202e0b service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:00.098541 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 615/1223] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:16:00 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:24.833063 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec23e9-7079-4951-a73e-dca629cee71a None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:24.833530 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec23e9-7079-4951-a73e-dca629cee71a None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:24.833610 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec23e9-7079-4951-a73e-dca629cee71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:24.851090 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-05ec23e9-7079-4951-a73e-dca629cee71a None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:16:24.852342 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-05ec23e9-7079-4951-a73e-dca629cee71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:24.859261 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 609/1224] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:16:24 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:16:39.319776 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:39.320198 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:39.320367 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:39.337175 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:16:39.338354 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:39.346216 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 616/1225] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:16:39 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:17:38.376603 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da5bc-8e1e-4680-86fd-fa7896ad8e25 None None] REQUEST_METHOD: `POST` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:38.377088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da5bc-8e1e-4680-86fd-fa7896ad8e25 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:38.377187 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da5bc-8e1e-4680-86fd-fa7896ad8e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:38.394681 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.auth.core [None req-ae8da5bc-8e1e-4680-86fd-fa7896ad8e25 None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:17:38.396017 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-ae8da5bc-8e1e-4680-86fd-fa7896ad8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:17:38.403901 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 610/1226] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:17:38 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:17:51.052454 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:17:51.071420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5956cb-2693-42ca-9639-af5560b99b3d None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:17:51.074916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:17:51.075555 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:51.075832 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:51.076100 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:51.084839 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:17:51.086389 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c84d9-fc47-4d12-80df-e9d925e09fd5 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:17:51.095731 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 617/1227] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:17:51 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:18:07.033354 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01c34f-095e-45c6-b841-885a68efdba2 None None] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:07.034357 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01c34f-095e-45c6-b841-885a68efdba2 None None] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:07.034646 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01c34f-095e-45c6-b841-885a68efdba2 None None] PATH_INFO: `/` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:07.036157 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 611/1228] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 12 07:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 07:18:07.041467 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:07.042280 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:07.042810 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:07.102659 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] MFA Rules not processed for user `61fa2aa07d994d02867b8bafc7ff2644`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:18:07.105050 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:18:07.124287 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 618/1229] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 12 07:18:07 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:18:07.137932 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01c34f-095e-45c6-b841-885a68efdba2 None None] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:07.160356 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01c34f-095e-45c6-b841-885a68efdba2 None None] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:07.180568 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:07.181526 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:07.182007 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:07.182470 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:07.192759 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:07.195225 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:07.216334 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 612/1230] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:18:07 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:18:13.891445 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:13.912230 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92f8b2-322f-43e6-8074-2062770e62cc None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:13.917094 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81c7999cb2445fca81343d207963903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:13.918281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:13.918582 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:13.918864 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:13.927243 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:13.928838 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:13.939075 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 619/1231] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:18:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:18:22.959140 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:23.045029 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7e9a-9bef-4bec-8138-965c97fe43fa service nova] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:23.051111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:23.052440 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:23.052758 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:23.053139 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] PATH_INFO: `/v3/users/8090215141204fa78dc82c054881a716` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:23.054903 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8090215141204fa78dc82c054881a716)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:23.056423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: WARNING py.warnings [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:18:23.056423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: warnings.warn(msg) May 12 07:18:23.056423 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: May 12 07:18:23.059227 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:23.134728 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8090215141204fa78dc82c054881a716'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.136415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8090215141204fa78dc82c054881a716'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.159775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8090215141204fa78dc82c054881a716'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.170563 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8090215141204fa78dc82c054881a716'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.171414 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8090215141204fa78dc82c054881a716'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.189242 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 613/1232] 10.222.0.71 () {58 vars in 1223 bytes} [Thu May 12 07:18:22 2022] DELETE /identity/v3/users/8090215141204fa78dc82c054881a716 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:18:23.368922 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:23.387148 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646173-581b-4ddd-9062-a1da8e45578c service placement] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:23.456407 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:23.457623 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:23.457918 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:23.458259 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] PATH_INFO: `/v3/projects/7d6e165d394346caa2debaca59c237df` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:23.459852 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d6e165d394346caa2debaca59c237df)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:23.461186 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: WARNING py.warnings [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 07:18:23.461186 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: warnings.warn(msg) May 12 07:18:23.461186 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: May 12 07:18:23.462795 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:23.527725 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6e165d394346caa2debaca59c237df', 'request_id': 'req-ca4363c0-0480-447a-9cb8-76990388d34a'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.535138 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6e165d394346caa2debaca59c237df', 'request_id': 'req-ca4363c0-0480-447a-9cb8-76990388d34a'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.552554 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6e165d394346caa2debaca59c237df', 'request_id': 'req-ca4363c0-0480-447a-9cb8-76990388d34a'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.570120 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] The token cache is being invalidate because project 7d6e165d394346caa2debaca59c237df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:18:23.570432 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.571252 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.572916 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 620/1233] 10.222.0.71 () {58 vars in 1232 bytes} [Thu May 12 07:18:23 2022] DELETE /identity/v3/projects/7d6e165d394346caa2debaca59c237df => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:18:23.577082 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:23.578766 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:18:23.593980 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ce84-fd56-44d0-a4fe-259d7a4d6c1d admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:23.656437 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:23.657311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:23.657587 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:23.657861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] PATH_INFO: `/v3/users/f6ae292e47d34608b5839cfe71f56d12` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:23.659088 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ae292e47d34608b5839cfe71f56d12)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:23.661125 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:23.719085 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ae292e47d34608b5839cfe71f56d12'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.720994 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ae292e47d34608b5839cfe71f56d12'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.741135 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ae292e47d34608b5839cfe71f56d12'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.749785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ae292e47d34608b5839cfe71f56d12'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.750785 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ae292e47d34608b5839cfe71f56d12'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:23.767883 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 614/1234] 10.222.0.71 () {58 vars in 1223 bytes} [Thu May 12 07:18:23 2022] DELETE /identity/v3/users/f6ae292e47d34608b5839cfe71f56d12 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:18:23.973083 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:23.975086 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:18:23.999093 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363c0-0480-447a-9cb8-76990388d34a admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:24.060112 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:24.061076 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:24.061330 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:24.061608 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] PATH_INFO: `/v3/projects/ea9936c619074d59ab71664f90fa412e` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:24.063232 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9936c619074d59ab71664f90fa412e)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:24.065223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:24.117760 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9936c619074d59ab71664f90fa412e', 'request_id': 'req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:24.123420 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9936c619074d59ab71664f90fa412e', 'request_id': 'req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:24.130195 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9936c619074d59ab71664f90fa412e', 'request_id': 'req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:24.145750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] The token cache is being invalidate because project ea9936c619074d59ab71664f90fa412e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:18:24.146193 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:24.147052 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-f9fcbaaa-be63-4c90-a2c6-e256ae9a3f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:18:24.148943 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 621/1235] 10.222.0.71 () {58 vars in 1232 bytes} [Thu May 12 07:18:23 2022] DELETE /identity/v3/projects/ea9936c619074d59ab71664f90fa412e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:20:00.463751 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:20:00.465349 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:00.522262 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb434-68c7-45d0-9592-6f8965bbb251 admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:20:00.573195 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:20:00.573863 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:00.574155 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:00.574432 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:00.576410 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:00.656726 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:20:00.659513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:20:00.676369 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 615/1236] 10.222.0.71 () {60 vars in 1396 bytes} [Thu May 12 07:20:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2804 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:20:01.783508 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:01.783961 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:01.784236 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:01.803188 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:20:01.804439 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:01.811770 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 622/1237] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:20:01 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:20:10.936474 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:20:10.938152 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:10.948675 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6ca1-224a-442f-9b51-8d5787d66091 service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:20:10.952333 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:20:10.952983 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:10.953267 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:10.953547 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:10.955283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:11.021311 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:20:11.022753 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:20:11.033415 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 616/1238] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:20:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:20:12.212958 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:20:12.224105 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62a6ea-1882-49af-b999-260168c3af4f None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:20:12.227774 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:20:12.228700 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:12.228981 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:12.229261 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:12.231203 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:12.244798 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:20:12.246241 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0e98c-3cdd-4698-a87b-a5b7895954b5 service neutron] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:20:12.256803 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 623/1239] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:20:12 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:21:07.846957 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:21:07.856351 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc057b-4629-40d1-9028-ee4254f2636d service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:21:07.859923 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:21:07.860636 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:07.860921 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:07.862176 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:07.863957 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:07.873491 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:21:07.874914 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:21:07.883319 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 617/1240] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:21:07 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:21:57.956905 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] REQUEST_METHOD: `POST` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:57.957407 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:57.957510 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:57.974598 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.auth.core [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] MFA Rules not processed for user `da4a363fd90b41f7973fbb95b77bc592`. Rule list: `[]` (Enabled: `True`). {{(pid=86910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:21:57.975895 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:57.984159 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 624/1241] 10.222.0.71 () {58 vars in 957 bytes} [Thu May 12 07:21:57 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:21:58.288131 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:21:58.296396 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35c91-e1c2-44e6-9208-7de1277b0cae service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:21:58.299927 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:21:58.300606 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:58.300891 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:58.301171 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:58.302926 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:58.312637 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:21:58.314052 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:21:58.321644 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 618/1242] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:21:58 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:21:58.747560 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:21:58.749042 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:58.829480 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa59c9-8b90-4bd6-a5a9-8e7cec7470f6 None None] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:21:58.834398 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81c7999cb2445fca81343d207963903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:21:58.835033 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:58.835310 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:58.835580 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:58.837336 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:58.848948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:21:58.850519 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:21:58.860562 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 625/1243] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:21:58 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:01.511164 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:01.512918 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:22:01.533159 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc32fc-a0ff-4b67-8707-f526319764da service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:01.549483 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:01.550081 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:01.550559 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:01.550841 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:01.552701 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:22:01.565711 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:01.567375 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:01.578449 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 619/1244] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:22:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:07.237129 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:07.249167 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb353-9047-4473-bd09-cfe247617300 service placement] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:07.255355 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:07.256006 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:07.256325 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:07.256624 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:07.258521 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:22:07.271147 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:07.272750 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:07.282923 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 626/1245] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:22:07 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:23:51.846136 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:23:51.895714 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f070e-e895-4a82-921c-be7f0bf42e0c service nova] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:23:51.901632 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81c7999cb2445fca81343d207963903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:23:51.902332 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:23:51.902624 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:23:51.902908 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:23:51.904775 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:23:51.936447 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:23:51.938233 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:23:51.949201 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 620/1246] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:23:51 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:24:25.633029 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:25.678005 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825448-f2f5-453e-85c4-869a4eaa493b service nova] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:25.683087 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fa2aa07d994d02867b8bafc7ff2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:25.684152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] REQUEST_METHOD: `GET` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:25.684152 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:25.684360 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:25.686098 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:24:25.698928 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:25.700835 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:25.712614 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 627/1247] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:24:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:24:31.089868 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:31.098761 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487da72-be67-4058-8afc-4b35276bed5a service placement] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:31.102320 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015718a382044581ba4fceb50c466ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de06908ab1d44487b63cc98d22f4d09e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:31.102957 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] REQUEST_METHOD: `GET` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:31.103239 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:31.103513 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:31.105296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:24:31.188388 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:31.189838 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:31.199133 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 621/1248] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 12 07:24:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:24:37.405948 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:37.408068 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:24:37.423785 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a706-e9e0-4b59-a8ff-25f91eae7f6b service nova] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:37.428377 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:37.429477 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:37.429827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:37.430177 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] PATH_INFO: `/v3/users/da4a363fd90b41f7973fbb95b77bc592` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:37.431475 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4a363fd90b41f7973fbb95b77bc592)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:37.434191 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:37.485775 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4a363fd90b41f7973fbb95b77bc592'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.493223 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4a363fd90b41f7973fbb95b77bc592'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.494023 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4a363fd90b41f7973fbb95b77bc592'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.506549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4a363fd90b41f7973fbb95b77bc592'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.507281 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4a363fd90b41f7973fbb95b77bc592'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.519677 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 628/1249] 10.222.0.71 () {58 vars in 1223 bytes} [Thu May 12 07:24:37 2022] DELETE /identity/v3/users/da4a363fd90b41f7973fbb95b77bc592 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:24:37.697111 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:37.706741 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118b8f2-a708-47b2-8ab0-e62ee60bb08f service neutron] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:37.762421 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:37.763283 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:37.763567 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:37.763899 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] PATH_INFO: `/v3/projects/9c4fbb7f5a4a43849dd0741818cea640` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:37.765055 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4fbb7f5a4a43849dd0741818cea640)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:37.767119 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:37.810861 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4fbb7f5a4a43849dd0741818cea640', 'request_id': 'req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.816752 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4fbb7f5a4a43849dd0741818cea640', 'request_id': 'req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.823360 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4fbb7f5a4a43849dd0741818cea640', 'request_id': 'req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.833696 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] The token cache is being invalidate because project 9c4fbb7f5a4a43849dd0741818cea640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:24:37.833979 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.834596 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.836112 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 622/1250] 10.222.0.71 () {58 vars in 1232 bytes} [Thu May 12 07:24:37 2022] DELETE /identity/v3/projects/9c4fbb7f5a4a43849dd0741818cea640 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:24:37.840282 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Authenticating user token {{(pid=86910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:37.841649 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.fernet_utils [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:24:37.854914 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38887e-6bde-4dad-a7e1-b506f4d366c7 admin admin] Validating token access rules against request {{(pid=86910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:37.910932 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:37.911807 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:37.912105 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] SCRIPT_NAME: `/identity` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:37.912408 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] PATH_INFO: `/v3/users/8840810a2db14b67a4191fb3a96dbad0` {{(pid=86910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:37.913625 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8840810a2db14b67a4191fb3a96dbad0)` {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:37.915549 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] RBAC: Authorization granted {{(pid=86910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:37.962793 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8840810a2db14b67a4191fb3a96dbad0'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.970116 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8840810a2db14b67a4191fb3a96dbad0'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.970827 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8840810a2db14b67a4191fb3a96dbad0'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.982720 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8840810a2db14b67a4191fb3a96dbad0'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.983370 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: DEBUG keystone.notifications [None req-c23189a1-622c-4ea9-b3f8-de1c6d65628a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8840810a2db14b67a4191fb3a96dbad0'} {{(pid=86910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:37.995292 dv-osbrick-830800-12-ceph devstack@keystone.service[86910]: [pid: 86910|app: 0|req: 629/1251] 10.222.0.71 () {58 vars in 1223 bytes} [Thu May 12 07:24:37 2022] DELETE /identity/v3/users/8840810a2db14b67a4191fb3a96dbad0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:24:38.165737 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Authenticating user token {{(pid=86909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:38.167179 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.fernet_utils [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:24:38.179655 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b5f4-4034-43e7-b6a6-e51c16e013bf admin admin] Validating token access rules against request {{(pid=86909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:38.234955 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed0de300758400388e11ebad1cc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb9a0833837c452ba8e446c72d6e4378', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:38.235819 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:38.236102 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:38.236408 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] PATH_INFO: `/v3/projects/c551385617cb4ed9878e4bb5092b4532` {{(pid=86909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:38.237588 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c551385617cb4ed9878e4bb5092b4532)` {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:38.239514 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] RBAC: Authorization granted {{(pid=86909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:38.284296 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c551385617cb4ed9878e4bb5092b4532', 'request_id': 'req-8c859807-7c89-40e9-b033-4991a946a848'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:38.290241 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c551385617cb4ed9878e4bb5092b4532', 'request_id': 'req-8c859807-7c89-40e9-b033-4991a946a848'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:38.298010 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c551385617cb4ed9878e4bb5092b4532', 'request_id': 'req-8c859807-7c89-40e9-b033-4991a946a848'} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:38.307945 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] The token cache is being invalidate because project c551385617cb4ed9878e4bb5092b4532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:24:38.308308 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:38.308938 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: DEBUG keystone.notifications [None req-8c859807-7c89-40e9-b033-4991a946a848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:24:38.310502 dv-osbrick-830800-12-ceph devstack@keystone.service[86909]: [pid: 86909|app: 0|req: 623/1252] 10.222.0.71 () {58 vars in 1232 bytes} [Thu May 12 07:24:38 2022] DELETE /identity/v3/projects/c551385617cb4ed9878e4bb5092b4532 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)